[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:15 dist-test-slave-00d6 krb5kdc[12405](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:15 dist-test-slave-00d6 krb5kdc[12405](info): set up 2 sockets
Sep 29 22:45:15 dist-test-slave-00d6 krb5kdc[12405](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260929 22:45:16.771965 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:16 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:16.890273 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45639
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:45639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:16.970661 12418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:16.970856 12418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:16.970878 12418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:16.971946 12418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:16.971980 12418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:16.971994 12418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:16.972007 12418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:16.972020 12418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:16.973433 12418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:45639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:16.973624 12418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:16.973804 12418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:16.978790 12423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:16.978801 12426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:16.978856 12418 server_base.cc:1034] running on GCE node
W20260929 22:45:16.978794 12424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:16.979250 12418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:16.979578 12418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:16.980782 12418 hybrid_clock.cc:648] HybridClock initialized: now 1790721916980763 us; error 35 us; skew 500 ppm
Sep 29 22:45:16 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721916, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:16.988967 12418 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:16.989383 12418 webserver.cc:460] Webserver started at http://127.12.27.190:34529/ using document root <none> and password file <none>
I20260929 22:45:16.989593 12418 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:16.989634 12418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:16.989722 12418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:16.990741 12418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "1b72b9d283c743e4863f8d361edf3381"
format_stamp: "Formatted at 2026-09-29 22:45:16 on dist-test-slave-00d6"
server_key: "1d9beee9522d3fe7a1bc80c8bb2dc94d"
server_key_iv: "06b4208c01d1297f793e861f4454146c"
server_key_version: "encryptionkey@0"
I20260929 22:45:16.991060 12418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "1b72b9d283c743e4863f8d361edf3381"
format_stamp: "Formatted at 2026-09-29 22:45:16 on dist-test-slave-00d6"
server_key: "1d9beee9522d3fe7a1bc80c8bb2dc94d"
server_key_iv: "06b4208c01d1297f793e861f4454146c"
server_key_version: "encryptionkey@0"
I20260929 22:45:16.992424 12418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:16.993137 12433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:16.993314 12418 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:16.993394 12418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1b72b9d283c743e4863f8d361edf3381"
format_stamp: "Formatted at 2026-09-29 22:45:16 on dist-test-slave-00d6"
server_key: "1d9beee9522d3fe7a1bc80c8bb2dc94d"
server_key_iv: "06b4208c01d1297f793e861f4454146c"
server_key_version: "encryptionkey@0"
I20260929 22:45:16.993449 12418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:17.005180 12418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:17.007501 12418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:17.007615 12418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:17.011471 12418 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:45639
I20260929 22:45:17.011495 12485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:45639 every 8 connection(s)
I20260929 22:45:17.011889 12418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:17.012786 12486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:17.015127 12486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381: Bootstrap starting.
I20260929 22:45:17.015126 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 12418
I20260929 22:45:17.015197 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:17.015777 12486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:17.015882 12398 external_mini_cluster.cc:1428] Setting key 37b1c4c3780715cd8b96aae29107e367
I20260929 22:45:17.016120 12486 log.cc:824] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:17.016896 12486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381: No bootstrap required, opened a new log
I20260929 22:45:17.019274 12486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b72b9d283c743e4863f8d361edf3381" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45639 } }
I20260929 22:45:17.019479 12486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:17.019528 12486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b72b9d283c743e4863f8d361edf3381, State: Initialized, Role: FOLLOWER
I20260929 22:45:17.019690 12486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b72b9d283c743e4863f8d361edf3381" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45639 } }
I20260929 22:45:17.019774 12486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:17.019797 12486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:17.019870 12486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:17.020684 12486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b72b9d283c743e4863f8d361edf3381" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45639 } }
I20260929 22:45:17.020766 12486 leader_election.cc:302] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b72b9d283c743e4863f8d361edf3381; no voters:
I20260929 22:45:17.020946 12486 leader_election.cc:288] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:17.020970 12491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:17.021070 12491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [term 1 LEADER]: Becoming Leader. State: Replica: 1b72b9d283c743e4863f8d361edf3381, State: Running, Role: LEADER
I20260929 22:45:17.021152 12491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b72b9d283c743e4863f8d361edf3381" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45639 } }
I20260929 22:45:17.021210 12486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:17.021492 12491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b72b9d283c743e4863f8d361edf3381" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b72b9d283c743e4863f8d361edf3381" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45639 } } }
I20260929 22:45:17.021574 12491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:17.021692 12491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b72b9d283c743e4863f8d361edf3381. Latest consensus state: current_term: 1 leader_uuid: "1b72b9d283c743e4863f8d361edf3381" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b72b9d283c743e4863f8d361edf3381" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45639 } } }
I20260929 22:45:17.021762 12491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:17.021888 12496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:17.022673 12496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:17.024394 12496 catalog_manager.cc:1347] Generated new cluster ID: c81bf253d8f947a6bd68bcaa3cc05abf
I20260929 22:45:17.024446 12496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:17.032519 12489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.016834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.12.27.190:45639)
0929 22:45:17.017016 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:17.017025 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:17.017327 (+ 302us) server_negotiation.cc:407] Connection header received
0929 22:45:17.019758 (+ 2431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:17.019764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:17.019842 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:17.019980 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:17.021905 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.023354 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.024768 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.025172 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.025293 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.028750 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:17.028754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:17.028754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:17.028765 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:17.030477 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.030937 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.030940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.030941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.031042 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.031308 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.031310 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.031310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.031549 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:17.031748 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:17.032024 (+ 276us) server_negotiation.cc:299] Negotiation successful
0929 22:45:17.032158 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260929 22:45:17.037563 12496 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:17.038174 12496 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:17.045953 12496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b72b9d283c743e4863f8d361edf3381: Generated new TSK 0
I20260929 22:45:17.046162 12496 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:17.074339 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45639
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:17.154827 12512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:17.155025 12512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:17.155047 12512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:17.156203 12512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:17.156244 12512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:17.156270 12512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:17.157646 12512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45639
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:17.157820 12512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:17.158007 12512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:45:17.163021 12512 server_base.cc:1034] running on GCE node
W20260929 22:45:17.163172 12520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:17.163038 12517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:17.163025 12518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:17.163511 12512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:17.163776 12512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:17.164959 12512 hybrid_clock.cc:648] HybridClock initialized: now 1790721917164946 us; error 29 us; skew 500 ppm
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:17.167433 12512 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:17.167848 12512 webserver.cc:460] Webserver started at http://127.12.27.129:44717/ using document root <none> and password file <none>
I20260929 22:45:17.168046 12512 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:17.168084 12512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:17.168169 12512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:17.169138 12512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "c7fc4f816c854aca97dc4252ad207aa2"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "743bb41d59f342bc524d42d0ac10f118"
server_key_iv: "84e5123b7f0178a2c1927bb75ce7d0ff"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.169445 12512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "c7fc4f816c854aca97dc4252ad207aa2"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "743bb41d59f342bc524d42d0ac10f118"
server_key_iv: "84e5123b7f0178a2c1927bb75ce7d0ff"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.170743 12512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:17.171418 12527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.171609 12512 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:17.171764 12512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "c7fc4f816c854aca97dc4252ad207aa2"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "743bb41d59f342bc524d42d0ac10f118"
server_key_iv: "84e5123b7f0178a2c1927bb75ce7d0ff"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.171847 12512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:17.200629 12512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:17.203092 12512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:17.203263 12512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:17.203501 12512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:17.203832 12512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:17.203886 12512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.203941 12512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:17.203969 12512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.209834 12512 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:34257
I20260929 22:45:17.209877 12640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:34257 every 8 connection(s)
I20260929 22:45:17.210191 12512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:17.219244 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 12512
I20260929 22:45:17.219329 12489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.210830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:33659 (local address 127.12.27.190:45639)
0929 22:45:17.210913 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:17.210915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:17.211094 (+ 179us) server_negotiation.cc:407] Connection header received
0929 22:45:17.211549 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:17.211550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:17.211564 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:17.211616 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:17.212554 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.213086 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.214036 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.214228 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.214276 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.216350 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:17.216351 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:17.216351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:17.216357 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:17.217779 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.218240 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.218241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.218242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.218313 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.218619 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.218620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.218620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.218761 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:17.218838 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:17.219127 (+ 289us) server_negotiation.cc:299] Negotiation successful
0929 22:45:17.219219 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 22:45:17.219336 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:17.219389 12643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.210779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45639 (local address 127.12.27.129:33659)
0929 22:45:17.210963 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:17.210998 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:17.211465 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:17.211717 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:17.211721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:17.212277 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:17.212474 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:17.212479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.213168 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.213168 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:17.213960 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:17.213963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.214296 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.214297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:17.214397 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.214839 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:17.214847 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:17.216265 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:17.217856 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:17.217863 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:17.217865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:17.218146 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:17.218395 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:17.218396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:17.218396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:17.218538 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:17.218831 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:17.218837 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:17.218987 (+ 150us) client_negotiation.cc:769] Sending connection context
0929 22:45:17.219079 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:45:17.219193 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260929 22:45:17.219550 12398 external_mini_cluster.cc:1428] Setting key 5e119e3773d96896786768fa863adb32
I20260929 22:45:17.219988 12641 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45639
I20260929 22:45:17.220069 12641 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:17.220273 12641 heartbeater.cc:511] Master 127.12.27.190:45639 requested a full tablet report, sending...
I20260929 22:45:17.220846 12450 ts_manager.cc:194] Registered new tserver with Master: c7fc4f816c854aca97dc4252ad207aa2 (127.12.27.129:34257)
I20260929 22:45:17.221719 12450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:33659
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:17.244347 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45639
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:17.322927 12646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:17.323153 12646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:17.323192 12646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:17.324404 12646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:17.324468 12646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:17.324517 12646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:17.325944 12646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45639
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:17.326198 12646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:17.326428 12646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:17.331218 12654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:17.331179 12652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:17.331363 12651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:17.331447 12646 server_base.cc:1034] running on GCE node
I20260929 22:45:17.331687 12646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:17.331914 12646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:17.333070 12646 hybrid_clock.cc:648] HybridClock initialized: now 1790721917333052 us; error 30 us; skew 500 ppm
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:17.335505 12646 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:17.335943 12646 webserver.cc:460] Webserver started at http://127.12.27.130:38741/ using document root <none> and password file <none>
I20260929 22:45:17.336124 12646 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:17.336164 12646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:17.336251 12646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:17.337212 12646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "0a413a983fb941868b93fa5654093884"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "9131a4748b07f7479419996f89573049"
server_key_iv: "91c0d37935a6347560ac68e2db03acb6"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.337505 12646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "0a413a983fb941868b93fa5654093884"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "9131a4748b07f7479419996f89573049"
server_key_iv: "91c0d37935a6347560ac68e2db03acb6"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.338776 12646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:17.339437 12661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.339588 12646 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:17.339694 12646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "0a413a983fb941868b93fa5654093884"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "9131a4748b07f7479419996f89573049"
server_key_iv: "91c0d37935a6347560ac68e2db03acb6"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.339761 12646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:17.381388 12646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:17.383204 12646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:17.383314 12646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:17.383507 12646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:17.383874 12646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:17.383909 12646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.383965 12646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:17.383989 12646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.389693 12646 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:42051
I20260929 22:45:17.389771 12774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:42051 every 8 connection(s)
I20260929 22:45:17.390102 12646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:17.398870 12489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.390828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:43693 (local address 127.12.27.190:45639)
0929 22:45:17.390897 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:17.390899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:17.391108 (+ 209us) server_negotiation.cc:407] Connection header received
0929 22:45:17.391575 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:17.391576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:17.391586 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:17.391705 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:17.392595 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.393145 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.394213 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.394390 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.394443 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.396626 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:17.396628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:17.396628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:17.396634 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:17.397821 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.398161 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.398161 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.398162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.398208 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.398397 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.398398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.398398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.398493 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:17.398541 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:17.398750 (+ 209us) server_negotiation.cc:299] Negotiation successful
0929 22:45:17.398809 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:45:17.399101 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 12646
I20260929 22:45:17.399185 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:17.399379 12398 external_mini_cluster.cc:1428] Setting key bb1b8e5ea12ddd6dbe33b345a37d1a63
I20260929 22:45:17.399631 12777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.390797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45639 (local address 127.12.27.130:43693)
0929 22:45:17.390981 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:17.391022 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:17.391488 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:17.391777 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:17.391781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:17.392325 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:17.392513 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:17.392517 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.393250 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.393252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:17.394132 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:17.394134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.394472 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.394473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:17.394583 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.395070 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:17.395078 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:17.396550 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:17.397885 (+ 1335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:17.397890 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:17.397892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:17.398101 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:17.398261 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:17.398262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:17.398262 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:17.398349 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:17.398546 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:17.398550 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:17.398650 (+ 100us) client_negotiation.cc:769] Sending connection context
0929 22:45:17.398727 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:45:17.398834 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":113,"threads_started":1}
I20260929 22:45:17.400116 12775 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45639
I20260929 22:45:17.400216 12775 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:17.400396 12775 heartbeater.cc:511] Master 127.12.27.190:45639 requested a full tablet report, sending...
I20260929 22:45:17.400745 12449 ts_manager.cc:194] Registered new tserver with Master: 0a413a983fb941868b93fa5654093884 (127.12.27.130:42051)
I20260929 22:45:17.401118 12449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:43693
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:17.422879 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45639
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:17.501546 12780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:17.501770 12780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:17.501806 12780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:17.502908 12780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:17.502975 12780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:17.503018 12780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:17.504434 12780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45639
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:17.504696 12780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:17.504906 12780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:17.509857 12788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:17.509935 12786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:17.510038 12780 server_base.cc:1034] running on GCE node
W20260929 22:45:17.510129 12785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:17.510322 12780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:17.510598 12780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:17.511756 12780 hybrid_clock.cc:648] HybridClock initialized: now 1790721917511752 us; error 35 us; skew 500 ppm
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:17.514170 12780 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:17.514529 12780 webserver.cc:460] Webserver started at http://127.12.27.131:33915/ using document root <none> and password file <none>
I20260929 22:45:17.514709 12780 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:17.514750 12780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:17.514837 12780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:17.515869 12780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "6c4130eec9ed441380e1c09342871ccb"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "d42ae80d778c561dcda3388ead1a19d1"
server_key_iv: "9f58aa3753bd5d2cc305dd49de927711"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.516166 12780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "6c4130eec9ed441380e1c09342871ccb"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "d42ae80d778c561dcda3388ead1a19d1"
server_key_iv: "9f58aa3753bd5d2cc305dd49de927711"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.517436 12780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:17.518100 12795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.518286 12780 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:17.518357 12780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "6c4130eec9ed441380e1c09342871ccb"
format_stamp: "Formatted at 2026-09-29 22:45:17 on dist-test-slave-00d6"
server_key: "d42ae80d778c561dcda3388ead1a19d1"
server_key_iv: "9f58aa3753bd5d2cc305dd49de927711"
server_key_version: "encryptionkey@0"
I20260929 22:45:17.518425 12780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:17.527340 12780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:17.529102 12780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:17.529206 12780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:17.529359 12780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:17.529654 12780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:17.529685 12780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.529728 12780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:17.529754 12780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:17.535202 12780 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:35213
I20260929 22:45:17.535277 12908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:35213 every 8 connection(s)
I20260929 22:45:17.535584 12780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:17.537009 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 12780
I20260929 22:45:17.537084 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:17.537271 12398 external_mini_cluster.cc:1428] Setting key fe00c2275da67c37e78912a4873033fb
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:17.545703 12489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.536413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:49321 (local address 127.12.27.190:45639)
0929 22:45:17.536474 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:17.536476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:17.536692 (+ 216us) server_negotiation.cc:407] Connection header received
0929 22:45:17.537210 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:17.537212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:17.537225 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:17.537286 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:17.539019 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.539508 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.540544 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.540755 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.540823 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.543181 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:17.543182 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:17.543182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:17.543189 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:17.544505 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.544886 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.544887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.544887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.544933 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.545178 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.545178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.545178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.545273 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:17.545322 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:17.545580 (+ 258us) server_negotiation.cc:299] Negotiation successful
0929 22:45:17.545638 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:45:17.545957 12911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.536384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45639 (local address 127.12.27.131:49321)
0929 22:45:17.536529 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:17.536568 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:17.537078 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:17.537356 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:17.537360 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:17.538144 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:17.538425 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:17.538430 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.539593 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.539594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:17.540459 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:17.540461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.540854 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.540856 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:17.540993 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.541448 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:17.541456 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:17.543089 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:17.544602 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:17.544607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:17.544608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:17.544819 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:17.545012 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:17.545012 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:17.545013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:17.545117 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:17.545348 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:17.545353 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:17.545462 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 22:45:17.545554 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:45:17.545668 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260929 22:45:17.546525 12909 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45639
I20260929 22:45:17.546602 12909 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:17.546736 12909 heartbeater.cc:511] Master 127.12.27.190:45639 requested a full tablet report, sending...
I20260929 22:45:17.547066 12449 ts_manager.cc:194] Registered new tserver with Master: 6c4130eec9ed441380e1c09342871ccb (127.12.27.131:35213)
I20260929 22:45:17.547394 12449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:49321
I20260929 22:45:17.549345 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:17.571585 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.564267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48986 (local address 127.12.27.129:34257)
0929 22:45:17.564477 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:17.564482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:17.564493 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:45:17.564520 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:17.564522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:17.564535 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:17.564606 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:17.565135 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.565874 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.566550 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.566848 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.566904 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.569058 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:17.569065 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:17.569065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:17.569071 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:17.570515 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.570818 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.570820 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.570821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.570883 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.571073 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.571074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.571074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.571200 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:17.571297 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:17.571357 (+ 60us) server_negotiation.cc:299] Negotiation successful
0929 22:45:17.571422 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":101,"threads_started":1}
W20260929 22:45:17.572037 12555 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48986
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12405](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:17.594175 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:17.587347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.12.27.129:34257)
0929 22:45:17.587519 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:17.587521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:17.587608 (+ 87us) server_negotiation.cc:407] Connection header received
0929 22:45:17.587729 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:17.587730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:17.587743 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:17.587816 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:17.588374 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.588870 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.589603 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:17.589809 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:17.589892 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:17.592080 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:17.592081 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:17.592081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:17.592087 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:17.593248 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.593581 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.593582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.593582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.593627 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:17.593788 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:17.593789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:17.593789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:17.593871 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:17.593954 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:17.594028 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:45:17.594086 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260929 22:45:17.594794 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 12512
I20260929 22:45:17.599521 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 12646
I20260929 22:45:17.604723 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 12780
I20260929 22:45:17.608827 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 12418
2026-09-29T22:45:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1930 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12923](info): set up 2 sockets
Sep 29 22:45:17 dist-test-slave-00d6 krb5kdc[12923](info): commencing operation
krb5kdc: starting...
W20260929 22:45:18.643537 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:18 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:18.755326 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:33919
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:33919
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:18.834200 12936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:18.834437 12936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:18.834482 12936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:18.835616 12936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:18.835721 12936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:18.835747 12936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:18.835777 12936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:18.835804 12936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:18.837232 12936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:33919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:33919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:18.837497 12936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:18.837708 12936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:18.842521 12942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:18.842532 12944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:18.842532 12941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:18.842564 12936 server_base.cc:1034] running on GCE node
I20260929 22:45:18.842914 12936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:18.843199 12936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:18.844336 12936 hybrid_clock.cc:648] HybridClock initialized: now 1790721918844327 us; error 28 us; skew 500 ppm
Sep 29 22:45:18 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721918, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:18.846771 12936 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:18.847311 12936 webserver.cc:460] Webserver started at http://127.12.27.190:42411/ using document root <none> and password file <none>
I20260929 22:45:18.847551 12936 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:18.847612 12936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:18.847762 12936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:18.848796 12936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4"
format_stamp: "Formatted at 2026-09-29 22:45:18 on dist-test-slave-00d6"
server_key: "503527187bdaede2edb347d453bd8778"
server_key_iv: "073e2743a4f8d306f1db0d9dffc15613"
server_key_version: "encryptionkey@0"
I20260929 22:45:18.849164 12936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4"
format_stamp: "Formatted at 2026-09-29 22:45:18 on dist-test-slave-00d6"
server_key: "503527187bdaede2edb347d453bd8778"
server_key_iv: "073e2743a4f8d306f1db0d9dffc15613"
server_key_version: "encryptionkey@0"
I20260929 22:45:18.850437 12936 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:18.851130 12951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:18.851292 12936 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:18.851387 12936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4"
format_stamp: "Formatted at 2026-09-29 22:45:18 on dist-test-slave-00d6"
server_key: "503527187bdaede2edb347d453bd8778"
server_key_iv: "073e2743a4f8d306f1db0d9dffc15613"
server_key_version: "encryptionkey@0"
I20260929 22:45:18.851466 12936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:18.872495 12936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:18.874275 12936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:18.874428 12936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:18.878286 12936 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:33919
I20260929 22:45:18.878322 13003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:33919 every 8 connection(s)
I20260929 22:45:18.878652 12936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:18.879534 13004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:18.879534 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 12936
I20260929 22:45:18.879623 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:18.879814 12398 external_mini_cluster.cc:1428] Setting key 7a1f0d3251f0c7c8c7996dfe7997ad52
I20260929 22:45:18.882910 13004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4: Bootstrap starting.
I20260929 22:45:18.883656 13004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:18.883948 13004 log.cc:824] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:18.884639 13004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4: No bootstrap required, opened a new log
I20260929 22:45:18.886361 13004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33919 } }
I20260929 22:45:18.886510 13004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Sep 29 22:45:18 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:18.886570 13004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848f4ae8bdd9490c90ffdd74e58d1eb4, State: Initialized, Role: FOLLOWER
I20260929 22:45:18.886719 13004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33919 } }
I20260929 22:45:18.886811 13004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:18.886847 13004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:18.886893 13004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:18.887517 13004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33919 } }
I20260929 22:45:18.887676 13004 leader_election.cc:302] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 848f4ae8bdd9490c90ffdd74e58d1eb4; no voters:
I20260929 22:45:18.887856 13004 leader_election.cc:288] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:18.887889 13009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:18.888130 13004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:18.888249 13009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 848f4ae8bdd9490c90ffdd74e58d1eb4, State: Running, Role: LEADER
I20260929 22:45:18.888336 13009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33919 } }
I20260929 22:45:18.888656 13010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33919 } } }
I20260929 22:45:18.888759 13010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:18.889456 13018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:18.888674 13011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 848f4ae8bdd9490c90ffdd74e58d1eb4. Latest consensus state: current_term: 1 leader_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848f4ae8bdd9490c90ffdd74e58d1eb4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33919 } } }
I20260929 22:45:18.889832 13011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:18.889958 13018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:18.891033 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:18.880462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38432 (local address 127.12.27.190:33919)
0929 22:45:18.880664 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:18.880679 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:18.880704 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:45:18.881185 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:18.881191 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:18.881238 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:18.881351 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:18.882132 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:18.882992 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:18.884129 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:18.884661 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:18.884787 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:18.887078 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:18.887081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:18.887081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:18.887090 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:18.889189 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:18.889620 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:18.889623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:18.889624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:18.889740 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:18.889972 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:18.889973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:18.889973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:18.890274 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:18.890431 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:18.890713 (+ 282us) server_negotiation.cc:299] Negotiation successful
0929 22:45:18.890845 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260929 22:45:18.891703 13018 catalog_manager.cc:1347] Generated new cluster ID: 03eba569b6024327961feabc2b17f013
I20260929 22:45:18.891778 13018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:18.920231 13018 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:18.920771 13018 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:18.922729 13018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 848f4ae8bdd9490c90ffdd74e58d1eb4: Generated new TSK 0
I20260929 22:45:18.922904 13018 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:18.950989 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:33919
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:19.031145 13030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:19.031361 13030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:19.031400 13030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:19.032606 13030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:19.032668 13030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:19.032712 13030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:19.034256 13030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:33919
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:19.034533 13030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:19.034750 13030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:45:19.039814 13030 server_base.cc:1034] running on GCE node
W20260929 22:45:19.039808 13036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:19.039809 13035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:19.039952 13038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:19.040283 13030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:19.040481 13030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:19.041616 13030 hybrid_clock.cc:648] HybridClock initialized: now 1790721919041603 us; error 29 us; skew 500 ppm
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:19.044137 13030 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:19.044544 13030 webserver.cc:460] Webserver started at http://127.12.27.129:40037/ using document root <none> and password file <none>
I20260929 22:45:19.044766 13030 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:19.044834 13030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:19.044981 13030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:19.046000 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "e3eed4ef85b441efbb35607245e65df1"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "69878b80987c8d122d78a70f0d4d7ce4"
server_key_iv: "57f0bb39469bb891c826a10b8c63c857"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.046358 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "e3eed4ef85b441efbb35607245e65df1"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "69878b80987c8d122d78a70f0d4d7ce4"
server_key_iv: "57f0bb39469bb891c826a10b8c63c857"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.047748 13030 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:19.048451 13045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.048631 13030 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:19.048727 13030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "e3eed4ef85b441efbb35607245e65df1"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "69878b80987c8d122d78a70f0d4d7ce4"
server_key_iv: "57f0bb39469bb891c826a10b8c63c857"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.048812 13030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:19.062793 13030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:19.064606 13030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:19.064760 13030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:19.064965 13030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:19.065253 13030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:19.065304 13030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.065338 13030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:19.065364 13030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.071007 13030 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:42381
I20260929 22:45:19.071074 13159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:42381 every 8 connection(s)
I20260929 22:45:19.071378 13030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:45:19.075475 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13030
I20260929 22:45:19.075549 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:19.075737 12398 external_mini_cluster.cc:1428] Setting key 43ada1aab256a73807528d25276756ce
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:19.080972 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.072128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:57463 (local address 127.12.27.190:33919)
0929 22:45:19.072208 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.072211 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.072379 (+ 168us) server_negotiation.cc:407] Connection header received
0929 22:45:19.073258 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.073259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.073269 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.073317 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.073876 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.074367 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.075327 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.075597 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.075708 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.078103 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.078105 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.078105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.078118 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.079570 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.080013 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.080014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.080015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.080077 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.080321 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.080322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.080322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.080438 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.080509 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.080782 (+ 273us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.080879 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 22:45:19.081139 13162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.072093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:33919 (local address 127.12.27.129:57463)
0929 22:45:19.072264 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.072297 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.073171 (+ 874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.073380 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.073383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.073621 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:19.073801 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.073805 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.074445 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.074445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.075228 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.075230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.075724 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.075725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.075865 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.076416 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:19.076427 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:19.078015 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:19.079697 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:19.079704 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:19.079706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:19.079923 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:19.080141 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:19.080142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:19.080142 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:19.080253 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:19.080513 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:19.080519 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:19.080650 (+ 131us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.080748 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.080900 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260929 22:45:19.081760 13160 heartbeater.cc:347] Connected to a master server at 127.12.27.190:33919
I20260929 22:45:19.081864 13160 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:19.082048 13160 heartbeater.cc:511] Master 127.12.27.190:33919 requested a full tablet report, sending...
I20260929 22:45:19.082558 12968 ts_manager.cc:194] Registered new tserver with Master: e3eed4ef85b441efbb35607245e65df1 (127.12.27.129:42381)
I20260929 22:45:19.083139 12968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:57463
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:19.100440 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:33919
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:19.181706 13165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:19.181926 13165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:19.181950 13165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:19.183030 13165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:19.183066 13165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:19.183094 13165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:19.184650 13165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:33919
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:19.184839 13165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:19.185011 13165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:19.190490 13171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:19.190583 13165 server_base.cc:1034] running on GCE node
W20260929 22:45:19.190307 13170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:19.190332 13173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:19.190909 13165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:19.191126 13165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:19.192304 13165 hybrid_clock.cc:648] HybridClock initialized: now 1790721919192286 us; error 37 us; skew 500 ppm
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:19.194955 13165 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:19.195395 13165 webserver.cc:460] Webserver started at http://127.12.27.130:39409/ using document root <none> and password file <none>
I20260929 22:45:19.195679 13165 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:19.195737 13165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:19.195825 13165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:19.196825 13165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "ed628d05c5364189979cec349b964688"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "98211e8bb258e0335b373c4776d7bece"
server_key_iv: "5de9235a74ba98f2c6a3be1cc652d3d6"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.197152 13165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "ed628d05c5364189979cec349b964688"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "98211e8bb258e0335b373c4776d7bece"
server_key_iv: "5de9235a74ba98f2c6a3be1cc652d3d6"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.198382 13165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:19.199062 13180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.199267 13165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:19.199357 13165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "ed628d05c5364189979cec349b964688"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "98211e8bb258e0335b373c4776d7bece"
server_key_iv: "5de9235a74ba98f2c6a3be1cc652d3d6"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.199431 13165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:19.220273 13165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:19.222616 13165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:19.222779 13165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:19.223014 13165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:19.223330 13165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:19.223362 13165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.223385 13165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:19.223433 13165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.229633 13165 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:45061
I20260929 22:45:19.229679 13294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:45061 every 8 connection(s)
I20260929 22:45:19.229993 13165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:45:19.234879 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13165
I20260929 22:45:19.234977 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:19.235141 12398 external_mini_cluster.cc:1428] Setting key b20b34a19872ca19711d166d5cfd94e4
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:19.239861 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.230699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:45161 (local address 127.12.27.190:33919)
0929 22:45:19.230745 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.230747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.231017 (+ 270us) server_negotiation.cc:407] Connection header received
0929 22:45:19.231979 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.231981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.231993 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.232063 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.232742 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.233347 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.234374 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.234595 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.234659 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.237121 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.237122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.237122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.237130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.238484 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.238903 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.238905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.238905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.238969 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.239217 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.239218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.239218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.239328 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.239400 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.239687 (+ 287us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.239770 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:45:19.240072 13297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.230655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:33919 (local address 127.12.27.130:45161)
0929 22:45:19.230813 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.230855 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.231833 (+ 978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.232136 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.232140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.232455 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:19.232658 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.232662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.233428 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.233429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.234282 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.234284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.234670 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.234671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.234831 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.235467 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:19.235477 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:19.237028 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:19.238580 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:19.238587 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:19.238589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:19.238814 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:19.239034 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:19.239034 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:19.239035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:19.239146 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:19.239392 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:19.239398 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:19.239536 (+ 138us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.239662 (+ 126us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.239823 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260929 22:45:19.240443 13295 heartbeater.cc:347] Connected to a master server at 127.12.27.190:33919
I20260929 22:45:19.240559 13295 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:19.240736 13295 heartbeater.cc:511] Master 127.12.27.190:33919 requested a full tablet report, sending...
I20260929 22:45:19.241074 12968 ts_manager.cc:194] Registered new tserver with Master: ed628d05c5364189979cec349b964688 (127.12.27.130:45061)
I20260929 22:45:19.241449 12968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:45161
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:19.260092 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:33919
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:19.338789 13300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:19.338982 13300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:19.339005 13300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:19.340206 13300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:19.340248 13300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:19.340299 13300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:19.341724 13300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:33919
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:19.341965 13300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:19.342202 13300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:19.347218 13305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:19.347225 13308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:19.347240 13300 server_base.cc:1034] running on GCE node
W20260929 22:45:19.347225 13306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:19.347735 13300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:19.347962 13300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:19.349114 13300 hybrid_clock.cc:648] HybridClock initialized: now 1790721919349100 us; error 27 us; skew 500 ppm
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:19.352373 13300 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:19.352963 13300 webserver.cc:460] Webserver started at http://127.12.27.131:35483/ using document root <none> and password file <none>
I20260929 22:45:19.353228 13300 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:19.353303 13300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:19.353441 13300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:19.354962 13300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "b5a5f96c5445498d86ddaf27bf095b2c"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "79757f7f9b4787a328aa72e590ddb5ca"
server_key_iv: "32db062930562bdca61f05988377569c"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.355387 13300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "b5a5f96c5445498d86ddaf27bf095b2c"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "79757f7f9b4787a328aa72e590ddb5ca"
server_key_iv: "32db062930562bdca61f05988377569c"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.357059 13300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260929 22:45:19.358088 13315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.358264 13300 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:19.358373 13300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "b5a5f96c5445498d86ddaf27bf095b2c"
format_stamp: "Formatted at 2026-09-29 22:45:19 on dist-test-slave-00d6"
server_key: "79757f7f9b4787a328aa72e590ddb5ca"
server_key_iv: "32db062930562bdca61f05988377569c"
server_key_version: "encryptionkey@0"
I20260929 22:45:19.358460 13300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:19.368695 13300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:19.370373 13300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:19.370518 13300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:19.370725 13300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:19.370994 13300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:19.371049 13300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.371088 13300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:19.371116 13300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:19.376677 13300 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:33915
I20260929 22:45:19.376750 13429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:33915 every 8 connection(s)
I20260929 22:45:19.377049 13300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:19.384341 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13300
I20260929 22:45:19.384441 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:19.384636 12398 external_mini_cluster.cc:1428] Setting key 535f5555b16dad89028058cfbaf79fe0
I20260929 22:45:19.386438 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.377755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:52373 (local address 127.12.27.190:33919)
0929 22:45:19.377810 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.377812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.378034 (+ 222us) server_negotiation.cc:407] Connection header received
0929 22:45:19.378959 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.378961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.378972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.379015 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.379610 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.380138 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.381136 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.381340 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.381423 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.383508 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.383509 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.383509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.383519 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.385045 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.385497 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.385498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.385498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.385560 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.385803 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.385804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.385805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.385924 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.386012 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.386273 (+ 261us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.386349 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:45:19.386634 13432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.377733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:33919 (local address 127.12.27.131:52373)
0929 22:45:19.377887 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.377927 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.378850 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.379091 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.379095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.379338 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:19.379515 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.379519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.380231 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.380232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.381033 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.381035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.381431 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.381432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.381557 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.382081 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:19.382088 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:19.383382 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:19.385135 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:19.385141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:19.385143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:19.385399 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:19.385625 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:19.385626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:19.385626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:19.385735 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:19.386006 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:19.386011 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:19.386145 (+ 134us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.386253 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.386404 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260929 22:45:19.387040 13430 heartbeater.cc:347] Connected to a master server at 127.12.27.190:33919
I20260929 22:45:19.387112 13430 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:19.387244 13430 heartbeater.cc:511] Master 127.12.27.190:33919 requested a full tablet report, sending...
I20260929 22:45:19.387521 12968 ts_manager.cc:194] Registered new tserver with Master: b5a5f96c5445498d86ddaf27bf095b2c (127.12.27.131:33915)
I20260929 22:45:19.387928 12968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:52373
I20260929 22:45:19.396310 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:45:19.403972 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.397836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38436 (local address 127.12.27.190:33919)
0929 22:45:19.397992 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.397994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.398030 (+ 36us) server_negotiation.cc:407] Connection header received
0929 22:45:19.398109 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.398110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.398120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.398203 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.398808 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.399285 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.400086 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.400273 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.400356 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.401515 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.401516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.401517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.401523 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.402765 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.403121 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.403122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.403122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.403182 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.403385 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.403385 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.403386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.403529 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.403628 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.403775 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.403855 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260929 22:45:19.405987 12968 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:19.407447 12968 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:19.413663 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.409730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32970 (local address 127.12.27.130:45061)
0929 22:45:19.410044 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.410048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.410057 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:19.410093 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.410095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.410109 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.410194 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:19.410356 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.411157 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.412652 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.413240 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.413339 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.413403 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.413550 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.413587 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":74,"threads_started":1}
I20260929 22:45:19.413657 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.409552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:45061 (local address 127.0.0.1:32970)
0929 22:45:19.409870 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.409880 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.409931 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.410218 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.410219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.410222 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:19.410275 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.410276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.411257 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.411258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.412572 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.412574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.413343 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.413344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.413423 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.413436 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.413533 (+ 97us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.413585 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":3,"thread_start_us":52,"threads_started":1}
I20260929 22:45:19.413965 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.409708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56228 (local address 127.12.27.131:33915)
0929 22:45:19.409887 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.409892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.409902 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:19.409943 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.409945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.409961 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.410044 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:19.410218 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.411358 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.412671 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.413381 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.413452 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.413503 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.413852 (+ 349us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.413896 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":77,"threads_started":1}
I20260929 22:45:19.413790 13438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.409552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:33915 (local address 127.0.0.1:56228)
0929 22:45:19.409706 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.409742 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.409805 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.410073 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.410076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.410078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:19.410142 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.410144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.411458 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.411459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.412567 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.412570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.413540 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.413541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.413606 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.413610 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.413657 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.413699 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":3,"thread_start_us":50,"threads_started":1}
I20260929 22:45:19.414040 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.409817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39980 (local address 127.12.27.129:42381)
0929 22:45:19.410356 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.410360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.410368 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:19.410407 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.410409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.410424 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.410498 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:19.410702 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.411730 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.412829 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.413525 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.413596 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.413647 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.413921 (+ 274us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.413959 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":74,"threads_started":1}
I20260929 22:45:19.413867 13439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.409574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:42381 (local address 127.0.0.1:39980)
0929 22:45:19.409893 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.409902 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.409940 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.410594 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.410595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.410597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:19.410638 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.410640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.411820 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.411821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.412745 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.412747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.413677 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.413678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.413726 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.413729 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.413774 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.413808 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":59,"threads_started":1}
I20260929 22:45:19.414853 13093 tablet_service.cc:1467] Processing CreateTablet for tablet 912b279b94b245f2abe1e76c04c38765 (DEFAULT_TABLE table=test-table [id=4e10a8cd11954d74968e803791321797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:19.414839 13363 tablet_service.cc:1467] Processing CreateTablet for tablet 912b279b94b245f2abe1e76c04c38765 (DEFAULT_TABLE table=test-table [id=4e10a8cd11954d74968e803791321797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:19.415017 13228 tablet_service.cc:1467] Processing CreateTablet for tablet 912b279b94b245f2abe1e76c04c38765 (DEFAULT_TABLE table=test-table [id=4e10a8cd11954d74968e803791321797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:19.415177 13093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 912b279b94b245f2abe1e76c04c38765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:19.415181 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 912b279b94b245f2abe1e76c04c38765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:19.415288 13228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 912b279b94b245f2abe1e76c04c38765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:19.417702 13444 tablet_bootstrap.cc:492] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1: Bootstrap starting.
I20260929 22:45:19.418330 13445 tablet_bootstrap.cc:492] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: Bootstrap starting.
I20260929 22:45:19.418522 13444 tablet_bootstrap.cc:654] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:19.418998 13445 tablet_bootstrap.cc:654] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:19.419094 13444 log.cc:824] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:19.419576 13445 log.cc:824] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:19.419791 13446 tablet_bootstrap.cc:492] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c: Bootstrap starting.
I20260929 22:45:19.419893 13444 tablet_bootstrap.cc:492] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1: No bootstrap required, opened a new log
I20260929 22:45:19.419960 13444 ts_tablet_manager.cc:1397] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:45:19.420327 13445 tablet_bootstrap.cc:492] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: No bootstrap required, opened a new log
I20260929 22:45:19.420361 13446 tablet_bootstrap.cc:654] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:19.420396 13445 ts_tablet_manager.cc:1397] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:45:19.420922 13446 log.cc:824] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:19.421581 13446 tablet_bootstrap.cc:492] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c: No bootstrap required, opened a new log
I20260929 22:45:19.421658 13446 ts_tablet_manager.cc:1397] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:19.421932 13444 raft_consensus.cc:348] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.422129 13444 raft_consensus.cc:374] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:19.422163 13444 raft_consensus.cc:729] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3eed4ef85b441efbb35607245e65df1, State: Initialized, Role: FOLLOWER
I20260929 22:45:19.422284 13444 consensus_queue.cc:260] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.422292 13445 raft_consensus.cc:348] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.422466 13445 raft_consensus.cc:374] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:19.422513 13445 raft_consensus.cc:729] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed628d05c5364189979cec349b964688, State: Initialized, Role: FOLLOWER
I20260929 22:45:19.422569 13444 ts_tablet_manager.cc:1428] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:19.422662 13445 consensus_queue.cc:260] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.422689 13160 heartbeater.cc:503] Master 127.12.27.190:33919 was elected leader, sending a full tablet report...
I20260929 22:45:19.422910 13445 ts_tablet_manager.cc:1428] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 22:45:19.422919 13295 heartbeater.cc:503] Master 127.12.27.190:33919 was elected leader, sending a full tablet report...
I20260929 22:45:19.423501 13450 raft_consensus.cc:482] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:19.423586 13450 raft_consensus.cc:504] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.423813 13446 raft_consensus.cc:348] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.423980 13446 raft_consensus.cc:374] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:19.424031 13446 raft_consensus.cc:729] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5a5f96c5445498d86ddaf27bf095b2c, State: Initialized, Role: FOLLOWER
I20260929 22:45:19.424127 13446 consensus_queue.cc:260] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.424217 13450 leader_election.cc:288] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed628d05c5364189979cec349b964688 (127.12.27.130:45061), b5a5f96c5445498d86ddaf27bf095b2c (127.12.27.131:33915)
I20260929 22:45:19.424393 13446 ts_tablet_manager.cc:1428] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:19.424400 13430 heartbeater.cc:503] Master 127.12.27.190:33919 was elected leader, sending a full tablet report...
I20260929 22:45:19.427089 13162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.424007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:45061 (local address 127.12.27.129:48073)
0929 22:45:19.424093 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.424103 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.424139 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.424302 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.424303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.424305 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:19.424369 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.424370 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.425434 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.425435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.426267 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.426269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.426848 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.426849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.426928 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.426932 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.426982 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.427022 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":28}
I20260929 22:45:19.427112 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.424108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:48073 (local address 127.12.27.130:45061)
0929 22:45:19.424149 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.424151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.424161 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:19.424184 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.424185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.424193 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.424252 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:19.424446 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.425375 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.426348 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.426776 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.426828 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.426834 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.427003 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.427036 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:45:19.427202 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.424474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:55019 (local address 127.12.27.131:33915)
0929 22:45:19.424505 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.424507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.424685 (+ 178us) server_negotiation.cc:407] Connection header received
0929 22:45:19.424743 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.424744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.424753 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.424803 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:19.424950 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.425588 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.426490 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.426857 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.426924 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.426931 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.427110 (+ 179us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.427150 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:45:19.427219 13453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.424312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:33915 (local address 127.12.27.129:55019)
0929 22:45:19.424632 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:19.424642 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:19.424697 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:19.424808 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:19.424809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:19.424811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:19.424867 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.424868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.425655 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.425655 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.426414 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:19.426417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.426937 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.426938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:19.427035 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.427039 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:19.427095 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:45:19.427134 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":76,"threads_started":1}
I20260929 22:45:19.427397 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912b279b94b245f2abe1e76c04c38765" candidate_uuid: "e3eed4ef85b441efbb35607245e65df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed628d05c5364189979cec349b964688" is_pre_election: true
I20260929 22:45:19.427479 13249 raft_consensus.cc:2454] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3eed4ef85b441efbb35607245e65df1 in term 0.
I20260929 22:45:19.427714 13047 leader_election.cc:302] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3eed4ef85b441efbb35607245e65df1, ed628d05c5364189979cec349b964688; no voters:
I20260929 22:45:19.427714 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912b279b94b245f2abe1e76c04c38765" candidate_uuid: "e3eed4ef85b441efbb35607245e65df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" is_pre_election: true
I20260929 22:45:19.427824 13384 raft_consensus.cc:2454] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3eed4ef85b441efbb35607245e65df1 in term 0.
I20260929 22:45:19.427835 13450 raft_consensus.cc:2781] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:19.427875 13450 raft_consensus.cc:482] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:19.427906 13450 raft_consensus.cc:3037] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:19.428510 13450 raft_consensus.cc:504] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.428634 13450 leader_election.cc:288] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [CANDIDATE]: Term 1 election: Requested vote from peers ed628d05c5364189979cec349b964688 (127.12.27.130:45061), b5a5f96c5445498d86ddaf27bf095b2c (127.12.27.131:33915)
I20260929 22:45:19.428777 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912b279b94b245f2abe1e76c04c38765" candidate_uuid: "e3eed4ef85b441efbb35607245e65df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed628d05c5364189979cec349b964688"
I20260929 22:45:19.428830 13249 raft_consensus.cc:3037] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:19.429364 13249 raft_consensus.cc:2454] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3eed4ef85b441efbb35607245e65df1 in term 1.
I20260929 22:45:19.429497 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912b279b94b245f2abe1e76c04c38765" candidate_uuid: "e3eed4ef85b441efbb35607245e65df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5a5f96c5445498d86ddaf27bf095b2c"
I20260929 22:45:19.429530 13047 leader_election.cc:302] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3eed4ef85b441efbb35607245e65df1, ed628d05c5364189979cec349b964688; no voters:
I20260929 22:45:19.429560 13384 raft_consensus.cc:3037] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:19.429636 13450 raft_consensus.cc:2781] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:19.429772 13450 raft_consensus.cc:686] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [term 1 LEADER]: Becoming Leader. State: Replica: e3eed4ef85b441efbb35607245e65df1, State: Running, Role: LEADER
I20260929 22:45:19.429859 13450 consensus_queue.cc:237] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } }
I20260929 22:45:19.430351 13384 raft_consensus.cc:2454] T 912b279b94b245f2abe1e76c04c38765 P b5a5f96c5445498d86ddaf27bf095b2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3eed4ef85b441efbb35607245e65df1 in term 1.
I20260929 22:45:19.430533 12968 catalog_manager.cc:5495] T 912b279b94b245f2abe1e76c04c38765 P e3eed4ef85b441efbb35607245e65df1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3eed4ef85b441efbb35607245e65df1 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "e3eed4ef85b441efbb35607245e65df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed628d05c5364189979cec349b964688" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 45061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5a5f96c5445498d86ddaf27bf095b2c" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 33915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3eed4ef85b441efbb35607245e65df1" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 42381 } health_report { overall_health: HEALTHY } } }
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:19.444237 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.437562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39990 (local address 127.12.27.129:42381)
0929 22:45:19.437621 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.437624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.437738 (+ 114us) server_negotiation.cc:407] Connection header received
0929 22:45:19.437774 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.437775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.437782 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.437833 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.438349 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.438780 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.439455 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.439678 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.439739 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.441851 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.441859 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.441859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.441866 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.443226 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.443519 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.443522 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.443522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.443571 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.443786 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.443787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.443787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.443914 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.444068 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.444118 (+ 50us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.444176 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:19.466028 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.459169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.12.27.129:42381)
0929 22:45:19.459238 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.459240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.459334 (+ 94us) server_negotiation.cc:407] Connection header received
0929 22:45:19.459435 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.459436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.459447 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.459515 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.460117 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.460603 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.461359 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.461563 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.461635 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.463763 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.463764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.463765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.463771 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.465040 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.465340 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.465341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.465341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.465387 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.465558 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.465559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.465559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.465643 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.465725 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.465905 (+ 180us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.465964 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260929 22:45:19.480530 13296 tablet.cc:2369] T 912b279b94b245f2abe1e76c04c38765 P ed628d05c5364189979cec349b964688: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[12923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:19.488201 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:19.481118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40002 (local address 127.12.27.129:42381)
0929 22:45:19.481206 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:19.481208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:19.481311 (+ 103us) server_negotiation.cc:407] Connection header received
0929 22:45:19.481405 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:19.481406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:19.481417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:19.481494 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:19.482063 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.482537 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.483283 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:19.483478 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:19.483552 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:19.485777 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:19.485778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:19.485778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:19.485786 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:19.487023 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.487389 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.487390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.487390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.487485 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:19.487730 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:19.487731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:19.487732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:19.487834 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:19.487916 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:19.488072 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 22:45:19.488134 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260929 22:45:19.488721 13073 tablet_service.cc:2908] Rejecting scan request for tablet 912b279b94b245f2abe1e76c04c38765: Uninitialized: clean time has not yet been initialized
I20260929 22:45:19.489814 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13030
I20260929 22:45:19.494289 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13165
I20260929 22:45:19.498600 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13300
I20260929 22:45:19.502832 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 12936
2026-09-29T22:45:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (1894 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[13468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[13468](info): set up 2 sockets
Sep 29 22:45:19 dist-test-slave-00d6 krb5kdc[13468](info): commencing operation
krb5kdc: starting...
W20260929 22:45:20.527705 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:20 dist-test-slave-00d6 krb5kdc[13468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:20.648389 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:37661
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:37661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:20.730505 13481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:20.730724 13481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:20.730747 13481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:20.731950 13481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:20.731992 13481 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 22:45:20.732005 13481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:20.732018 13481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:20.732031 13481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:20.732044 13481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:20.733526 13481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:37661
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:37661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:20.733783 13481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:20.734061 13481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:20.740435 13486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:20.740530 13487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:20.740715 13489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:20.740796 13481 server_base.cc:1034] running on GCE node
I20260929 22:45:20.741079 13481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:20.741384 13481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:20.742524 13481 hybrid_clock.cc:648] HybridClock initialized: now 1790721920742501 us; error 40 us; skew 500 ppm
Sep 29 22:45:20 dist-test-slave-00d6 krb5kdc[13468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721920, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:20.745220 13481 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:20.745672 13481 webserver.cc:460] Webserver started at http://127.12.27.190:34097/ using document root <none> and password file <none>
I20260929 22:45:20.745859 13481 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:20.745898 13481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:20.745985 13481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:20.746984 13481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "524b6b18bbad4f7ca1fe5eb756fc041f"
format_stamp: "Formatted at 2026-09-29 22:45:20 on dist-test-slave-00d6"
server_key: "4337f8abb3a51760fc80e1c5982213b3"
server_key_iv: "24097a66e44ea4829f862011338b6a8d"
server_key_version: "encryptionkey@0"
I20260929 22:45:20.747277 13481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "524b6b18bbad4f7ca1fe5eb756fc041f"
format_stamp: "Formatted at 2026-09-29 22:45:20 on dist-test-slave-00d6"
server_key: "4337f8abb3a51760fc80e1c5982213b3"
server_key_iv: "24097a66e44ea4829f862011338b6a8d"
server_key_version: "encryptionkey@0"
I20260929 22:45:20.748651 13481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:20.749341 13496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:20.749516 13481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:20.749588 13481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "524b6b18bbad4f7ca1fe5eb756fc041f"
format_stamp: "Formatted at 2026-09-29 22:45:20 on dist-test-slave-00d6"
server_key: "4337f8abb3a51760fc80e1c5982213b3"
server_key_iv: "24097a66e44ea4829f862011338b6a8d"
server_key_version: "encryptionkey@0"
I20260929 22:45:20.749641 13481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:20.762823 13481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:20.765203 13481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:20.765316 13481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:20.770249 13481 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:37661
I20260929 22:45:20.770303 13559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:37661 every 8 connection(s)
I20260929 22:45:20.770628 13481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:20.771230 13560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:20.772959 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13481
I20260929 22:45:20.773065 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:20.773221 12398 external_mini_cluster.cc:1428] Setting key 691dd281998f3d4ad6aacbefb2083999
I20260929 22:45:20.773981 13560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: Bootstrap starting.
I20260929 22:45:20.774696 13560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:20.775022 13560 log.cc:824] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:20.775863 13560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: No bootstrap required, opened a new log
I20260929 22:45:20.778249 13560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37661 } }
I20260929 22:45:20.778441 13560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:20.778488 13560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 524b6b18bbad4f7ca1fe5eb756fc041f, State: Initialized, Role: FOLLOWER
I20260929 22:45:20.778647 13560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37661 } }
I20260929 22:45:20.778738 13560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:20.778775 13560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:20.778818 13560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:20.779368 13560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37661 } }
I20260929 22:45:20.779500 13560 leader_election.cc:302] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 524b6b18bbad4f7ca1fe5eb756fc041f; no voters:
I20260929 22:45:20.779703 13560 leader_election.cc:288] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:20.779747 13565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:20.779912 13565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [term 1 LEADER]: Becoming Leader. State: Replica: 524b6b18bbad4f7ca1fe5eb756fc041f, State: Running, Role: LEADER
I20260929 22:45:20.779974 13560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:20.780005 13565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37661 } }
I20260929 22:45:20.780377 13565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 524b6b18bbad4f7ca1fe5eb756fc041f. Latest consensus state: current_term: 1 leader_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37661 } } }
I20260929 22:45:20.780457 13565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:20.780387 13566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524b6b18bbad4f7ca1fe5eb756fc041f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37661 } } }
I20260929 22:45:20.780591 13566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f [sys.catalog]: This master's current role is: LEADER
Sep 29 22:45:20 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:20.781576 13572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:20.782126 13572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:20.783859 13572 catalog_manager.cc:1347] Generated new cluster ID: 4ff100b169f742b3838c3b154f041f70
I20260929 22:45:20.783910 13572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:20.785477 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:20.773765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53050 (local address 127.12.27.190:37661)
0929 22:45:20.773969 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:20.773978 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:20.774013 (+ 35us) server_negotiation.cc:407] Connection header received
0929 22:45:20.774627 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:20.774636 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:20.774713 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:20.774902 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:20.775729 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.776878 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.777986 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.778411 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.778537 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:20.781395 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:20.781400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:20.781401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:20.781414 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:20.783535 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:20.783984 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:20.783987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:20.783987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:20.784101 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:20.784300 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:20.784301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:20.784301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:20.784572 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:20.784688 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:20.785141 (+ 453us) server_negotiation.cc:299] Negotiation successful
0929 22:45:20.785271 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
I20260929 22:45:20.802975 13572 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:20.803756 13572 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:20.811473 13572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: Generated new TSK 0
I20260929 22:45:20.811708 13572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:20.836746 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37661
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:20.917567 13586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:20.917771 13586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:20.917796 13586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:20.918900 13586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:20.918938 13586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:20.918965 13586 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:45:20.918982 13586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:20.920351 13586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:37661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:20.920545 13586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:20.920715 13586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:20.925829 13592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:20.925841 13591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:20.925872 13594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:20.926133 13586 server_base.cc:1034] running on GCE node
I20260929 22:45:20.926339 13586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:20.926560 13586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:20.927709 13586 hybrid_clock.cc:648] HybridClock initialized: now 1790721920927687 us; error 28 us; skew 500 ppm
Sep 29 22:45:20 dist-test-slave-00d6 krb5kdc[13468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721920, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:20.930341 13586 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:20.930775 13586 webserver.cc:460] Webserver started at http://127.12.27.129:41505/ using document root <none> and password file <none>
I20260929 22:45:20.931028 13586 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:20.931098 13586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:20.931245 13586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:20.932402 13586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "410e1aa7f1494ab89d20a706f3553f1b"
format_stamp: "Formatted at 2026-09-29 22:45:20 on dist-test-slave-00d6"
server_key: "e77d8f532ca95ea734952cf8ce0b8bce"
server_key_iv: "d903be8508a54c0b6d0b9d9a07238a28"
server_key_version: "encryptionkey@0"
I20260929 22:45:20.932781 13586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "410e1aa7f1494ab89d20a706f3553f1b"
format_stamp: "Formatted at 2026-09-29 22:45:20 on dist-test-slave-00d6"
server_key: "e77d8f532ca95ea734952cf8ce0b8bce"
server_key_iv: "d903be8508a54c0b6d0b9d9a07238a28"
server_key_version: "encryptionkey@0"
I20260929 22:45:20.934060 13586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:20.934733 13601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:20.934890 13586 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:20.934984 13586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "410e1aa7f1494ab89d20a706f3553f1b"
format_stamp: "Formatted at 2026-09-29 22:45:20 on dist-test-slave-00d6"
server_key: "e77d8f532ca95ea734952cf8ce0b8bce"
server_key_iv: "d903be8508a54c0b6d0b9d9a07238a28"
server_key_version: "encryptionkey@0"
I20260929 22:45:20.935062 13586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:20.979382 13586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:20.981634 13586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:20.981789 13586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:20.982302 13586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:20.982363 13586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:20.982406 13586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:20.982434 13586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:20.988956 13586 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:43565
I20260929 22:45:20.989037 13717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:43565 every 8 connection(s)
I20260929 22:45:20.989377 13586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:45:20 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721920, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:20.991868 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13586
I20260929 22:45:20.991976 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:20.992172 12398 external_mini_cluster.cc:1428] Setting key cd57a5790683748d1ebf06d2e421a1e4
I20260929 22:45:20.993556 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:20.982828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:44779 (local address 127.12.27.190:37661)
0929 22:45:20.982905 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:20.982908 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:20.983084 (+ 176us) server_negotiation.cc:407] Connection header received
0929 22:45:20.983673 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:20.983675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:20.983689 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:20.983767 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:20.984628 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.985476 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.987046 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.987403 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.987487 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:20.990405 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:20.990406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:20.990407 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:20.990413 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:20.992047 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:20.992483 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:20.992484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:20.992484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:20.992562 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:20.992845 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:20.992846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:20.992846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:20.993005 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:20.993077 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:20.993411 (+ 334us) server_negotiation.cc:299] Negotiation successful
0929 22:45:20.993486 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 22:45:20.993868 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:20.982801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.12.27.129:44779)
0929 22:45:20.982971 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:20.983012 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:20.983500 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:20.983843 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:20.983849 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:20.984223 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:20.984513 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:20.984519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.985580 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.985582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:20.986944 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:20.986947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.987510 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.987510 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:20.987716 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:20.988283 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:20.988295 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:20.990315 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:20.992126 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:20.992132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:20.992133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:20.992395 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:20.992635 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:20.992635 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:20.992636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:20.992742 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:20.993089 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:20.993096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:20.993271 (+ 175us) client_negotiation.cc:769] Sending connection context
0929 22:45:20.993388 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 22:45:20.993591 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260929 22:45:20.994395 13718 heartbeater.cc:347] Connected to a master server at 127.12.27.190:37661
I20260929 22:45:20.994486 13718 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:20.994700 13718 heartbeater.cc:511] Master 127.12.27.190:37661 requested a full tablet report, sending...
I20260929 22:45:20.995265 13513 ts_manager.cc:194] Registered new tserver with Master: 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565)
I20260929 22:45:20.996246 13513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:44779
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:45:21.002085 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:20.995385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42511 (local address 127.12.27.190:37661)
0929 22:45:20.995424 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:20.995426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:20.995695 (+ 269us) server_negotiation.cc:407] Connection header received
0929 22:45:20.995756 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:20.995757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:20.995768 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:20.995824 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:20.996149 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.996915 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.997634 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.997984 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.998070 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:20.999127 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:20.999128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:20.999129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:20.999136 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.000863 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.001237 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.001238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.001239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.001298 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.001582 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.001583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.001583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.001754 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.001826 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.001956 (+ 130us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.002020 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:21.002136 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:20.995456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.12.27.129:42511)
0929 22:45:20.995604 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:20.995616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:20.995707 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:20.995826 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:20.995826 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:20.996020 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:20.996077 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:20.996078 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.997017 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.997018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:20.997549 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:20.997551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:20.998092 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:20.998094 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:20.998161 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:20.998690 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:20.998694 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:20.999031 (+ 337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:21.000955 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.000956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.000956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.001159 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.001366 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.001367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.001367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.001422 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.001824 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:21.001824 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:21.001869 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.001923 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.002016 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:21.018718 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37661
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:21.100224 13727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:21.100435 13727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:21.100459 13727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:21.101675 13727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:21.101724 13727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:21.101745 13727 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:45:21.101763 13727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:21.103143 13727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:37661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:21.103320 13727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:21.103492 13727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:21.108487 13733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:21.108500 13727 server_base.cc:1034] running on GCE node
W20260929 22:45:21.108466 13735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:21.108462 13732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:21.109009 13727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:21.109278 13727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:21.110423 13727 hybrid_clock.cc:648] HybridClock initialized: now 1790721921110402 us; error 38 us; skew 500 ppm
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:21.113054 13727 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:21.113503 13727 webserver.cc:460] Webserver started at http://127.12.27.130:44361/ using document root <none> and password file <none>
I20260929 22:45:21.113742 13727 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:21.113812 13727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:21.113960 13727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:21.115018 13727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "bebd0d3b1c6a455c9f217ac1f2526a00"
format_stamp: "Formatted at 2026-09-29 22:45:21 on dist-test-slave-00d6"
server_key: "c16a1622d1e281d561129bab0e43d3ce"
server_key_iv: "f2c32856649484c75532b861b2c24eb4"
server_key_version: "encryptionkey@0"
I20260929 22:45:21.115377 13727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "bebd0d3b1c6a455c9f217ac1f2526a00"
format_stamp: "Formatted at 2026-09-29 22:45:21 on dist-test-slave-00d6"
server_key: "c16a1622d1e281d561129bab0e43d3ce"
server_key_iv: "f2c32856649484c75532b861b2c24eb4"
server_key_version: "encryptionkey@0"
I20260929 22:45:21.116814 13727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:21.117669 13742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.117854 13727 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:21.117959 13727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "bebd0d3b1c6a455c9f217ac1f2526a00"
format_stamp: "Formatted at 2026-09-29 22:45:21 on dist-test-slave-00d6"
server_key: "c16a1622d1e281d561129bab0e43d3ce"
server_key_iv: "f2c32856649484c75532b861b2c24eb4"
server_key_version: "encryptionkey@0"
I20260929 22:45:21.118052 13727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:21.129639 13727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:21.131850 13727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:21.132009 13727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:21.132517 13727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:21.132582 13727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.132628 13727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:21.132653 13727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:21.139479 13727 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:41791
I20260929 22:45:21.139564 13858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:41791 every 8 connection(s)
I20260929 22:45:21.139904 13727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:45:21.142736 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.133043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:37535 (local address 127.12.27.190:37661)
0929 22:45:21.133091 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.133094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.133380 (+ 286us) server_negotiation.cc:407] Connection header received
0929 22:45:21.133952 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.133954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.133968 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.134026 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.134886 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.135766 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.136868 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.137083 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.137161 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.140085 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.140087 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.140087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.140096 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.141435 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.141843 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.141845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.141845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.141949 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.142200 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.142201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.142202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.142319 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.142375 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.142605 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.142673 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:45:21.142877 13751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.133046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.12.27.130:37535)
0929 22:45:21.133240 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.133288 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.133835 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.134132 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.134137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.134502 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:21.134784 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.134792 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.135870 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.135871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.136760 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.136763 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.137179 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.137180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.137324 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.137875 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:21.137883 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:21.139900 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:21.141506 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.141512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.141514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.141754 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.142019 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.142019 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.142020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.142115 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.142375 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:21.142378 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:21.142492 (+ 114us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.142573 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.142690 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260929 22:45:21.143409 13859 heartbeater.cc:347] Connected to a master server at 127.12.27.190:37661
I20260929 22:45:21.143503 13859 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:21.143540 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13727
I20260929 22:45:21.143620 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:21.143743 13859 heartbeater.cc:511] Master 127.12.27.190:37661 requested a full tablet report, sending...
I20260929 22:45:21.143868 12398 external_mini_cluster.cc:1428] Setting key eb403c08fbc8abff4b38b1812469f9e4
I20260929 22:45:21.144174 13514 ts_manager.cc:194] Registered new tserver with Master: bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791)
I20260929 22:45:21.144693 13514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:37535
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
I20260929 22:45:21.153637 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.144552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:58765 (local address 127.12.27.190:37661)
0929 22:45:21.144590 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.144591 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.145859 (+ 1268us) server_negotiation.cc:407] Connection header received
0929 22:45:21.145888 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.145889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.145901 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.146020 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.146305 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.147036 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.147730 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.148073 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.148146 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.149004 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.149006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.149006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.149014 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.151426 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.151876 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.151878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.151878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.151987 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.152804 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.152805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.152806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.153104 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.153185 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.153422 (+ 237us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.153509 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:45:21.153646 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.144512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.12.27.130:58765)
0929 22:45:21.145786 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.145796 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.145849 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.146020 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.146021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.146185 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:21.146246 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.146248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.147125 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.147126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.147614 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.147615 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.148142 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.148143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.148196 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.148638 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:21.148642 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:21.148918 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:21.151511 (+ 2593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.151512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.151513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.151768 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.152379 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.152379 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.152380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.152733 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.153215 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:21.153217 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:21.153277 (+ 60us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.153382 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.153491 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1252,"thread_start_us":69,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:21.175024 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37661
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:38129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:21.264187 13868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:21.264387 13868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:21.264410 13868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:21.265574 13868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:21.265616 13868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:21.265636 13868 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:45:21.265692 13868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:21.267081 13868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:38129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:37661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:21.267313 13868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:21.267540 13868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:21.272416 13874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:21.272532 13873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:21.272625 13868 server_base.cc:1034] running on GCE node
W20260929 22:45:21.272626 13876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:21.272926 13868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:21.273164 13868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:21.274322 13868 hybrid_clock.cc:648] HybridClock initialized: now 1790721921274316 us; error 36 us; skew 500 ppm
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:21.276903 13868 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:21.277336 13868 webserver.cc:460] Webserver started at http://127.12.27.131:44823/ using document root <none> and password file <none>
I20260929 22:45:21.277568 13868 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:21.277639 13868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:21.277791 13868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:21.278848 13868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "ee63399a8009471d80796c9e0e715d6f"
format_stamp: "Formatted at 2026-09-29 22:45:21 on dist-test-slave-00d6"
server_key: "41f8e4850f5005d158fb1b930b7fd1ab"
server_key_iv: "a4a27a2ac6b85d83d4fcbd1e203e1545"
server_key_version: "encryptionkey@0"
I20260929 22:45:21.279206 13868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "ee63399a8009471d80796c9e0e715d6f"
format_stamp: "Formatted at 2026-09-29 22:45:21 on dist-test-slave-00d6"
server_key: "41f8e4850f5005d158fb1b930b7fd1ab"
server_key_iv: "a4a27a2ac6b85d83d4fcbd1e203e1545"
server_key_version: "encryptionkey@0"
I20260929 22:45:21.280817 13868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:21.281678 13883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.281853 13868 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:21.281934 13868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "ee63399a8009471d80796c9e0e715d6f"
format_stamp: "Formatted at 2026-09-29 22:45:21 on dist-test-slave-00d6"
server_key: "41f8e4850f5005d158fb1b930b7fd1ab"
server_key_iv: "a4a27a2ac6b85d83d4fcbd1e203e1545"
server_key_version: "encryptionkey@0"
I20260929 22:45:21.281991 13868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:21.303507 13868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:21.306008 13868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:21.306119 13868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:21.306668 13868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:21.306710 13868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.306731 13868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:21.306766 13868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.313570 13868 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:43455
I20260929 22:45:21.313637 13998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:43455 every 8 connection(s)
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:21.313946 13868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:21.316874 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.307164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:48863 (local address 127.12.27.190:37661)
0929 22:45:21.307246 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.307249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.307396 (+ 147us) server_negotiation.cc:407] Connection header received
0929 22:45:21.307949 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.307951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.307965 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.308054 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.308906 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.309752 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.311359 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.311724 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.311799 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.314475 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.314476 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.314476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.314491 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.315754 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.316106 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.316107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.316107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.316156 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.316361 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.316361 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.316361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.316463 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.316524 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.316751 (+ 227us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.316811 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 22:45:21.317059 13892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.307118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.12.27.131:48863)
0929 22:45:21.307262 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.307301 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.307839 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.308141 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.308145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.308517 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:21.308799 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.308804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.309854 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.309855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.311224 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.311227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.311823 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.311823 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.311952 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.312521 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:21.312531 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:21.314376 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:21.315822 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.315827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.315829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.316041 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.316213 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.316214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.316214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.316306 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.316522 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:21.316526 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:21.316642 (+ 116us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.316723 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.316834 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260929 22:45:21.317584 13999 heartbeater.cc:347] Connected to a master server at 127.12.27.190:37661
I20260929 22:45:21.317668 13999 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:21.317866 13999 heartbeater.cc:511] Master 127.12.27.190:37661 requested a full tablet report, sending...
I20260929 22:45:21.318184 13513 ts_manager.cc:194] Registered new tserver with Master: ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455)
I20260929 22:45:21.318574 13513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:48863
I20260929 22:45:21.320504 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 13868
I20260929 22:45:21.320574 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:21.320729 12398 external_mini_cluster.cc:1428] Setting key 6bd2ceaf257a2ffb72d131b92155fb81
I20260929 22:45:21.321566 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:45:21.324194 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.318690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:37769 (local address 127.12.27.190:37661)
0929 22:45:21.318727 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.318729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.318811 (+ 82us) server_negotiation.cc:407] Connection header received
0929 22:45:21.318881 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.318882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.318892 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.318939 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.319280 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.319785 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.320438 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.320729 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.320810 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.321773 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.321774 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.321774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.321781 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.323101 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.323433 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.323434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.323434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.323491 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.323700 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.323701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.323702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.323808 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.323882 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.324038 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.324108 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:45:21.324203 14005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.318648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.12.27.131:37769)
0929 22:45:21.318758 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.318768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.318823 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.318957 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.318958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.319157 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:21.319209 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.319211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.319862 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.319862 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.320355 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.320356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.320822 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.320824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.320901 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.321370 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:21.321374 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:21.321666 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:21.323184 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.323185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.323186 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.323352 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.323554 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.323554 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.323555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.323611 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.323873 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:21.323874 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:21.323917 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.324011 (+ 94us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.324110 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":60,"threads_started":1}
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:21.344340 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.337679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53062 (local address 127.12.27.190:37661)
0929 22:45:21.337838 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.337840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.337857 (+ 17us) server_negotiation.cc:407] Connection header received
0929 22:45:21.337881 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.337882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.337891 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.337941 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.338529 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.339028 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.339754 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.339935 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.339996 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.342095 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.342096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.342096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.342102 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.343397 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.343791 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.343792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.343792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.343842 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.343977 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.343978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.343978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.344067 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.344140 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.344221 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.344276 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260929 22:45:21.346118 13513 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:21.347783 13513 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:21.354127 14016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.350052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:43455 (local address 127.0.0.1:39952)
0929 22:45:21.350161 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.350200 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.350261 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.350517 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.350520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.350522 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.350588 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.350589 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.351722 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.351723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.352903 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.352906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.353821 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.353823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.353897 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.353911 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.353990 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.354044 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":65,"threads_started":1}
I20260929 22:45:21.354139 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.350159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39952 (local address 127.12.27.131:43455)
0929 22:45:21.350319 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.350325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.350335 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:21.350372 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.350374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.350407 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.350509 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.350672 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.351590 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.353000 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.353735 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.353821 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.353882 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.354010 (+ 128us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.354046 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260929 22:45:21.354390 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.350076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41791 (local address 127.0.0.1:49526)
0929 22:45:21.350359 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.350370 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.350422 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.350738 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.350739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.350742 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.350794 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.350795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.352258 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.352259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.353301 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.353303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.354170 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.354171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.354238 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.354244 (+ 6us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.354279 (+ 35us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.354323 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":10,"thread_start_us":85,"threads_started":1}
I20260929 22:45:21.354737 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.350407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49526 (local address 127.12.27.130:41791)
0929 22:45:21.350557 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.350562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.350572 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:21.350612 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.350615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.350631 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.350868 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.350994 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.352154 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.353377 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.354069 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.354489 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.354573 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.354603 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.354645 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260929 22:45:21.354759 13933 tablet_service.cc:1467] Processing CreateTablet for tablet a2c16c561bf64550bbbfe2b7fc3e5919 (DEFAULT_TABLE table=test-table [id=f903e5f79909404181888c8569c03e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:21.355166 13933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2c16c561bf64550bbbfe2b7fc3e5919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.355333 14017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.350262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43565 (local address 127.0.0.1:57736)
0929 22:45:21.350658 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.350667 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.350710 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.351049 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.351050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.351052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.351086 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.351087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.352341 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.352342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.353453 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.353455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.355104 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.355105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.355176 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.355180 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.355211 (+ 31us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.355254 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":60,"threads_started":1}
I20260929 22:45:21.355372 13792 tablet_service.cc:1467] Processing CreateTablet for tablet a2c16c561bf64550bbbfe2b7fc3e5919 (DEFAULT_TABLE table=test-table [id=f903e5f79909404181888c8569c03e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:21.355723 13792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2c16c561bf64550bbbfe2b7fc3e5919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.355744 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.350655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57736 (local address 127.12.27.129:43565)
0929 22:45:21.350844 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.350848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.350857 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:21.350893 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.350894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.350910 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.350988 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.351148 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.352267 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.353567 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.354943 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.355492 (+ 549us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.355556 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.355581 (+ 25us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.355619 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
I20260929 22:45:21.356249 13651 tablet_service.cc:1467] Processing CreateTablet for tablet a2c16c561bf64550bbbfe2b7fc3e5919 (DEFAULT_TABLE table=test-table [id=f903e5f79909404181888c8569c03e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:21.356539 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2c16c561bf64550bbbfe2b7fc3e5919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.358528 14022 tablet_bootstrap.cc:492] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Bootstrap starting.
I20260929 22:45:21.359145 14023 tablet_bootstrap.cc:492] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Bootstrap starting.
I20260929 22:45:21.359658 14022 tablet_bootstrap.cc:654] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.359592 14024 tablet_bootstrap.cc:492] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Bootstrap starting.
I20260929 22:45:21.359799 14023 tablet_bootstrap.cc:654] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.360041 14022 log.cc:824] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:21.360143 14023 log.cc:824] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:21.360329 14024 tablet_bootstrap.cc:654] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.360646 14024 log.cc:824] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:21.360881 14022 tablet_bootstrap.cc:492] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: No bootstrap required, opened a new log
I20260929 22:45:21.360977 14022 ts_tablet_manager.cc:1397] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:45:21.361307 14024 tablet_bootstrap.cc:492] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: No bootstrap required, opened a new log
I20260929 22:45:21.361377 14024 ts_tablet_manager.cc:1397] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:21.362918 14022 raft_consensus.cc:348] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.363153 14022 raft_consensus.cc:374] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.363193 14022 raft_consensus.cc:729] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee63399a8009471d80796c9e0e715d6f, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.363310 14022 consensus_queue.cc:260] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.363287 14024 raft_consensus.cc:348] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.363415 14024 raft_consensus.cc:374] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.363474 14024 raft_consensus.cc:729] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410e1aa7f1494ab89d20a706f3553f1b, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.363570 14022 ts_tablet_manager.cc:1428] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:21.363587 14024 consensus_queue.cc:260] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.363711 13999 heartbeater.cc:503] Master 127.12.27.190:37661 was elected leader, sending a full tablet report...
I20260929 22:45:21.363860 14024 ts_tablet_manager.cc:1428] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:45:21.363897 13718 heartbeater.cc:503] Master 127.12.27.190:37661 was elected leader, sending a full tablet report...
I20260929 22:45:21.364024 14023 tablet_bootstrap.cc:492] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: No bootstrap required, opened a new log
I20260929 22:45:21.364094 14023 ts_tablet_manager.cc:1397] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260929 22:45:21.365821 14023 raft_consensus.cc:348] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.365933 14023 raft_consensus.cc:374] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.365986 14023 raft_consensus.cc:729] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebd0d3b1c6a455c9f217ac1f2526a00, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.366093 14023 consensus_queue.cc:260] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.366338 14023 ts_tablet_manager.cc:1428] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:45:21.366401 13859 heartbeater.cc:503] Master 127.12.27.190:37661 was elected leader, sending a full tablet report...
I20260929 22:45:21.368351 14030 raft_consensus.cc:482] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:21.368413 14030 raft_consensus.cc:504] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.368651 14030 leader_election.cc:288] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455), 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565)
I20260929 22:45:21.371476 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.368788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:43455 (local address 127.12.27.130:60233)
0929 22:45:21.368980 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.368988 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.369029 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.369181 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.369182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.369183 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.369267 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.369269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.369860 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.369860 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.370610 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.370612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.371251 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.371251 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.371307 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.371310 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.371366 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.371393 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":19,"thread_start_us":96,"threads_started":1}
I20260929 22:45:21.371482 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.368815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:60233 (local address 127.12.27.131:43455)
0929 22:45:21.369064 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.369067 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.369074 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:21.369095 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.369096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.369105 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.369161 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.369335 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.369785 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.370717 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.371162 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.371199 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.371206 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.371376 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.371413 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228}
I20260929 22:45:21.371523 13751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.368785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43565 (local address 127.12.27.130:55243)
0929 22:45:21.368897 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.368927 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.368971 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.369104 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.369104 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.369106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.369165 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.369166 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.369809 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.369811 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.370550 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.370552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.371208 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.371209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.371296 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.371305 (+ 9us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.371371 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.371410 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":1}
I20260929 22:45:21.371800 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.368909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:55243 (local address 127.12.27.129:43565)
0929 22:45:21.368950 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.368952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.368964 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:45:21.369048 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.369049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.369056 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.369102 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.369236 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.369734 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.370642 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.371129 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.371211 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.371218 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.371694 (+ 476us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.371736 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:45:21.371816 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2c16c561bf64550bbbfe2b7fc3e5919" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee63399a8009471d80796c9e0e715d6f" is_pre_election: true
I20260929 22:45:21.371958 13953 raft_consensus.cc:2454] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 0.
I20260929 22:45:21.372107 13671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2c16c561bf64550bbbfe2b7fc3e5919" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410e1aa7f1494ab89d20a706f3553f1b" is_pre_election: true
I20260929 22:45:21.372179 13746 leader_election.cc:302] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bebd0d3b1c6a455c9f217ac1f2526a00, ee63399a8009471d80796c9e0e715d6f; no voters:
I20260929 22:45:21.372237 13671 raft_consensus.cc:2454] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 0.
I20260929 22:45:21.372303 14030 raft_consensus.cc:2781] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:21.372349 14030 raft_consensus.cc:482] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:21.372385 14030 raft_consensus.cc:3037] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.373221 14030 raft_consensus.cc:504] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.373358 14030 leader_election.cc:288] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 election: Requested vote from peers ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455), 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565)
I20260929 22:45:21.373476 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2c16c561bf64550bbbfe2b7fc3e5919" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee63399a8009471d80796c9e0e715d6f"
I20260929 22:45:21.373515 13671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2c16c561bf64550bbbfe2b7fc3e5919" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410e1aa7f1494ab89d20a706f3553f1b"
I20260929 22:45:21.373562 13953 raft_consensus.cc:3037] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.373612 13671 raft_consensus.cc:3037] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.374251 13953 raft_consensus.cc:2454] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 1.
I20260929 22:45:21.374262 13671 raft_consensus.cc:2454] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 1.
I20260929 22:45:21.374401 13746 leader_election.cc:302] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bebd0d3b1c6a455c9f217ac1f2526a00, ee63399a8009471d80796c9e0e715d6f; no voters:
I20260929 22:45:21.374524 14030 raft_consensus.cc:2781] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:21.374656 14030 raft_consensus.cc:686] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 LEADER]: Becoming Leader. State: Replica: bebd0d3b1c6a455c9f217ac1f2526a00, State: Running, Role: LEADER
I20260929 22:45:21.374745 14030 consensus_queue.cc:237] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } }
I20260929 22:45:21.375458 13513 catalog_manager.cc:5495] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:21.382143 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.379479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49534 (local address 127.12.27.130:41791)
0929 22:45:21.379699 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.379701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.379708 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:21.379741 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.379741 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.379756 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.379804 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:21.380124 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.380643 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.381428 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.381655 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.381708 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.381878 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.381963 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.382019 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.382062 (+ 43us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.382077 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200}
I20260929 22:45:21.383783 13953 raft_consensus.cc:1261] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Refusing update from remote peer bebd0d3b1c6a455c9f217ac1f2526a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:21.383790 13671 raft_consensus.cc:1261] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Refusing update from remote peer bebd0d3b1c6a455c9f217ac1f2526a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:21.384114 14030 consensus_queue.cc:1035] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:21.384282 14032 consensus_queue.cc:1035] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:21.386624 14035 mvcc.cc:205] Tried to move back new op lower bound from 7334796989985431552 to 7334796989951488000. Current Snapshot: MvccSnapshot[applied={T|T < 7334796989985431552}]
I20260929 22:45:21.386672 14036 mvcc.cc:205] Tried to move back new op lower bound from 7334796989985431552 to 7334796989951488000. Current Snapshot: MvccSnapshot[applied={T|T < 7334796989985431552}]
I20260929 22:45:21.386750 14037 mvcc.cc:205] Tried to move back new op lower bound from 7334796989985431552 to 7334796989951488000. Current Snapshot: MvccSnapshot[applied={T|T < 7334796989985431552}]
I20260929 22:45:21.390304 13514 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:21.390405 13514 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:21.391191 13514 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: Sending DeleteTablet for 3 replicas of tablet a2c16c561bf64550bbbfe2b7fc3e5919
I20260929 22:45:21.391539 13792 tablet_service.cc:1514] Processing DeleteTablet for tablet a2c16c561bf64550bbbfe2b7fc3e5919 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:21 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49526
I20260929 22:45:21.391557 13933 tablet_service.cc:1514] Processing DeleteTablet for tablet a2c16c561bf64550bbbfe2b7fc3e5919 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:21 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:39952
I20260929 22:45:21.391785 13651 tablet_service.cc:1514] Processing DeleteTablet for tablet a2c16c561bf64550bbbfe2b7fc3e5919 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:21 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:57736
I20260929 22:45:21.391837 13514 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:21.391975 13514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:21.392100 14047 tablet_replica.cc:330] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: stopping tablet replica
I20260929 22:45:21.392100 14048 tablet_replica.cc:330] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: stopping tablet replica
I20260929 22:45:21.392230 14048 raft_consensus.cc:2229] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:21.392241 14047 raft_consensus.cc:2229] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:21.392386 14047 raft_consensus.cc:2258] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:21.392726 14048 raft_consensus.cc:2258] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:21.393204 13651 tablet_service.cc:1467] Processing CreateTablet for tablet 81b76d9ea60245da9ad65c2b8dd3150b (DEFAULT_TABLE table=test-table [id=fedeb47bba9640b3b080a4857e01bbb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:21.393329 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81b76d9ea60245da9ad65c2b8dd3150b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.393435 14048 ts_tablet_manager.cc:1905] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:21.393482 13933 tablet_service.cc:1467] Processing CreateTablet for tablet 81b76d9ea60245da9ad65c2b8dd3150b (DEFAULT_TABLE table=test-table [id=fedeb47bba9640b3b080a4857e01bbb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:21.393606 13933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81b76d9ea60245da9ad65c2b8dd3150b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.394701 14024 tablet_bootstrap.cc:492] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Bootstrap starting.
I20260929 22:45:21.395020 14022 tablet_bootstrap.cc:492] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Bootstrap starting.
I20260929 22:45:21.395089 14024 tablet_bootstrap.cc:654] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.395422 14022 tablet_bootstrap.cc:654] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.395599 13792 tablet_service.cc:1467] Processing CreateTablet for tablet 81b76d9ea60245da9ad65c2b8dd3150b (DEFAULT_TABLE table=test-table [id=fedeb47bba9640b3b080a4857e01bbb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:21.395737 13792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81b76d9ea60245da9ad65c2b8dd3150b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.395974 14048 ts_tablet_manager.cc:1918] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:21.396034 14046 tablet_replica.cc:330] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: stopping tablet replica
I20260929 22:45:21.396131 14046 raft_consensus.cc:2229] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:21.396251 14046 raft_consensus.cc:2258] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:21.396257 14047 ts_tablet_manager.cc:1905] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:21.396601 14048 log.cc:1196] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/a2c16c561bf64550bbbfe2b7fc3e5919
I20260929 22:45:21.396730 14046 ts_tablet_manager.cc:1905] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:21.397063 14048 ts_tablet_manager.cc:1939] T a2c16c561bf64550bbbfe2b7fc3e5919 P 410e1aa7f1494ab89d20a706f3553f1b: Deleting consensus metadata
I20260929 22:45:21.397137 14023 tablet_bootstrap.cc:492] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Bootstrap starting.
I20260929 22:45:21.397506 14023 tablet_bootstrap.cc:654] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.397596 13498 catalog_manager.cc:4841] TS 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565): tablet a2c16c561bf64550bbbfe2b7fc3e5919 (table test-table [id=f903e5f79909404181888c8569c03e40]) successfully deleted
I20260929 22:45:21.397939 14022 tablet_bootstrap.cc:492] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: No bootstrap required, opened a new log
I20260929 22:45:21.397986 14022 ts_tablet_manager.cc:1397] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 22:45:21.398084 14024 tablet_bootstrap.cc:492] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: No bootstrap required, opened a new log
I20260929 22:45:21.398124 14024 ts_tablet_manager.cc:1397] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 22:45:21.398116 14022 raft_consensus.cc:348] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.398173 14022 raft_consensus.cc:374] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.398192 14022 raft_consensus.cc:729] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee63399a8009471d80796c9e0e715d6f, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.398242 14022 consensus_queue.cc:260] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.398283 14046 ts_tablet_manager.cc:1918] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:21.398267 14024 raft_consensus.cc:348] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.398325 14022 ts_tablet_manager.cc:1428] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:21.398334 14024 raft_consensus.cc:374] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.398341 14046 log.cc:1196] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/a2c16c561bf64550bbbfe2b7fc3e5919
I20260929 22:45:21.398358 14024 raft_consensus.cc:729] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410e1aa7f1494ab89d20a706f3553f1b, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.398408 14024 consensus_queue.cc:260] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.398489 14047 ts_tablet_manager.cc:1918] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:21.398550 14047 log.cc:1196] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/a2c16c561bf64550bbbfe2b7fc3e5919
I20260929 22:45:21.398550 14024 ts_tablet_manager.cc:1428] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:21.398608 14046 ts_tablet_manager.cc:1939] T a2c16c561bf64550bbbfe2b7fc3e5919 P bebd0d3b1c6a455c9f217ac1f2526a00: Deleting consensus metadata
I20260929 22:45:21.398741 14029 raft_consensus.cc:482] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:21.398779 14029 raft_consensus.cc:504] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.398810 14047 ts_tablet_manager.cc:1939] T a2c16c561bf64550bbbfe2b7fc3e5919 P ee63399a8009471d80796c9e0e715d6f: Deleting consensus metadata
I20260929 22:45:21.398963 13498 catalog_manager.cc:4841] TS bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791): tablet a2c16c561bf64550bbbfe2b7fc3e5919 (table test-table [id=f903e5f79909404181888c8569c03e40]) successfully deleted
I20260929 22:45:21.399056 14029 leader_election.cc:288] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791), ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455)
I20260929 22:45:21.399184 13500 catalog_manager.cc:4841] TS ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455): tablet a2c16c561bf64550bbbfe2b7fc3e5919 (table test-table [id=f903e5f79909404181888c8569c03e40]) successfully deleted
I20260929 22:45:21.402439 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.399754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:49001 (local address 127.12.27.130:41791)
0929 22:45:21.399791 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.399793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.399999 (+ 206us) server_negotiation.cc:407] Connection header received
0929 22:45:21.400060 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.400061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.400070 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.400124 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.400268 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.400718 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.401670 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.402040 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.402123 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.402134 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.402325 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.402366 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:45:21.402667 14053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.399632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41791 (local address 127.12.27.129:49001)
0929 22:45:21.399946 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.399955 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.400009 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.400126 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.400127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.400129 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.400191 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.400192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.400800 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.400801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.401578 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.401580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.402137 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.402139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.402205 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.402211 (+ 6us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.402511 (+ 300us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.402577 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":276,"threads_started":1}
I20260929 22:45:21.402776 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.399230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:43455 (local address 127.12.27.129:37485)
0929 22:45:21.399301 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.399314 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.399350 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.399582 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.399583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.399585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:21.399689 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.399691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.400599 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.400600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.401788 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.401791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.402536 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.402537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.402622 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.402625 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.402672 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.402710 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":28}
I20260929 22:45:21.403028 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.399415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:37485 (local address 127.12.27.131:43455)
0929 22:45:21.399459 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.399461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.399468 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:21.399487 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.399488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.399496 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.399540 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:21.399762 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.400504 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.401887 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.402416 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.402497 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.402504 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.402936 (+ 432us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.402973 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:45:21.403146 13812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81b76d9ea60245da9ad65c2b8dd3150b" candidate_uuid: "410e1aa7f1494ab89d20a706f3553f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" is_pre_election: true
I20260929 22:45:21.403223 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81b76d9ea60245da9ad65c2b8dd3150b" candidate_uuid: "410e1aa7f1494ab89d20a706f3553f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee63399a8009471d80796c9e0e715d6f" is_pre_election: true
I20260929 22:45:21.403301 13953 raft_consensus.cc:2454] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 410e1aa7f1494ab89d20a706f3553f1b in term 0.
W20260929 22:45:21.403465 13603 leader_election.cc:341] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791): Illegal state: must be running to vote when last-logged opid is not known
I20260929 22:45:21.403590 13605 leader_election.cc:302] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 410e1aa7f1494ab89d20a706f3553f1b, ee63399a8009471d80796c9e0e715d6f; no voters: bebd0d3b1c6a455c9f217ac1f2526a00
I20260929 22:45:21.403764 14029 raft_consensus.cc:2781] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:21.403812 14029 raft_consensus.cc:482] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:21.403844 14029 raft_consensus.cc:3037] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.404407 14029 raft_consensus.cc:504] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.404539 14029 leader_election.cc:288] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [CANDIDATE]: Term 1 election: Requested vote from peers bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791), ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455)
I20260929 22:45:21.404687 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81b76d9ea60245da9ad65c2b8dd3150b" candidate_uuid: "410e1aa7f1494ab89d20a706f3553f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee63399a8009471d80796c9e0e715d6f"
I20260929 22:45:21.404706 13812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81b76d9ea60245da9ad65c2b8dd3150b" candidate_uuid: "410e1aa7f1494ab89d20a706f3553f1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00"
I20260929 22:45:21.404753 13953 raft_consensus.cc:3037] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Advancing to term 1
W20260929 22:45:21.404901 13603 leader_election.cc:341] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791): Illegal state: must be running to vote when last-logged opid is not known
I20260929 22:45:21.405328 13953 raft_consensus.cc:2454] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410e1aa7f1494ab89d20a706f3553f1b in term 1.
I20260929 22:45:21.405475 13605 leader_election.cc:302] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 410e1aa7f1494ab89d20a706f3553f1b, ee63399a8009471d80796c9e0e715d6f; no voters: bebd0d3b1c6a455c9f217ac1f2526a00
I20260929 22:45:21.405570 14029 raft_consensus.cc:2781] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:21.405635 14029 raft_consensus.cc:686] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 1 LEADER]: Becoming Leader. State: Replica: 410e1aa7f1494ab89d20a706f3553f1b, State: Running, Role: LEADER
I20260929 22:45:21.405689 14029 consensus_queue.cc:237] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.406316 13514 catalog_manager.cc:5495] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129). New cstate: current_term: 1 leader_uuid: "410e1aa7f1494ab89d20a706f3553f1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:21.412037 14023 tablet_bootstrap.cc:492] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: No bootstrap required, opened a new log
I20260929 22:45:21.412088 14023 ts_tablet_manager.cc:1397] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20260929 22:45:21.412256 14023 raft_consensus.cc:348] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.412313 14023 raft_consensus.cc:374] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.412328 14023 raft_consensus.cc:729] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebd0d3b1c6a455c9f217ac1f2526a00, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.412379 14023 consensus_queue.cc:260] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.412472 14023 ts_tablet_manager.cc:1428] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721920, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:21.444363 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.436442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37661 (local address 127.0.0.1:53066)
0929 22:45:21.436628 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.436636 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.436697 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.436839 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.436840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.437214 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:21.437261 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.437263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.438217 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.438219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.438839 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.438841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.439292 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.439292 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.439332 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.439956 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:21.439960 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:21.441540 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:21.443188 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.443196 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.443198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.443471 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.443731 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:21.443732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:21.443732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:21.443779 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:21.444081 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:21.444089 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:21.444144 (+ 55us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.444199 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.444289 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
I20260929 22:45:21.444468 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.436494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53066 (local address 127.12.27.190:37661)
0929 22:45:21.436562 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.436564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.436702 (+ 138us) server_negotiation.cc:407] Connection header received
0929 22:45:21.436739 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.436740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.436752 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.436827 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.437321 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.438127 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.438918 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.439217 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.439287 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.441633 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.441634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.441634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.441640 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.443109 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.443565 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.443566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.443567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.443660 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.443868 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.443869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.443870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.444008 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.444078 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.444245 (+ 167us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.444352 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":40}
I20260929 22:45:21.446439 13514 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:53066:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 22:45:21.446658 13514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:21.448029 13792 tablet_service.cc:1467] Processing CreateTablet for tablet 9dc4fa4e070942458fd4978af3ee947a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1526a0a176b0455889ea57d8dda3a15f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:45:21.448048 13933 tablet_service.cc:1467] Processing CreateTablet for tablet 9dc4fa4e070942458fd4978af3ee947a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1526a0a176b0455889ea57d8dda3a15f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:45:21.448046 13651 tablet_service.cc:1467] Processing CreateTablet for tablet 9dc4fa4e070942458fd4978af3ee947a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1526a0a176b0455889ea57d8dda3a15f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:45:21.448185 13792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dc4fa4e070942458fd4978af3ee947a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.448185 13933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dc4fa4e070942458fd4978af3ee947a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.448186 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dc4fa4e070942458fd4978af3ee947a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:21.449611 14023 tablet_bootstrap.cc:492] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: Bootstrap starting.
I20260929 22:45:21.449658 14022 tablet_bootstrap.cc:492] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: Bootstrap starting.
I20260929 22:45:21.449963 14023 tablet_bootstrap.cc:654] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.450049 14022 tablet_bootstrap.cc:654] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.450376 14024 tablet_bootstrap.cc:492] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: Bootstrap starting.
I20260929 22:45:21.450765 14024 tablet_bootstrap.cc:654] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:21.450872 14023 tablet_bootstrap.cc:492] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: No bootstrap required, opened a new log
I20260929 22:45:21.450945 14023 ts_tablet_manager.cc:1397] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:21.451103 14023 raft_consensus.cc:348] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.451187 14023 raft_consensus.cc:374] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.451212 14023 raft_consensus.cc:729] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebd0d3b1c6a455c9f217ac1f2526a00, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.451259 14023 consensus_queue.cc:260] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.451359 14023 ts_tablet_manager.cc:1428] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:21.451468 14040 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.451568 14040 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:21.451725 14024 tablet_bootstrap.cc:492] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: No bootstrap required, opened a new log
I20260929 22:45:21.451771 14024 ts_tablet_manager.cc:1397] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:21.451910 14024 raft_consensus.cc:348] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.451977 14024 raft_consensus.cc:374] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.451983 14022 tablet_bootstrap.cc:492] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: No bootstrap required, opened a new log
I20260929 22:45:21.452003 14024 raft_consensus.cc:729] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410e1aa7f1494ab89d20a706f3553f1b, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.452024 14022 ts_tablet_manager.cc:1397] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:45:21.452059 14024 consensus_queue.cc:260] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.452150 14024 ts_tablet_manager.cc:1428] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.452167 14022 raft_consensus.cc:348] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.452235 14022 raft_consensus.cc:374] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:21.452266 14022 raft_consensus.cc:729] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee63399a8009471d80796c9e0e715d6f, State: Initialized, Role: FOLLOWER
I20260929 22:45:21.452316 14022 consensus_queue.cc:260] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.452350 14052 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.452404 14022 ts_tablet_manager.cc:1428] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:21.452421 14052 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:21.452479 14028 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.452572 14028 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 22:45:21.490373 13719 tablet.cc:2369] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:45:21.564615 14000 tablet.cc:2369] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:21.626261 14040 raft_consensus.cc:482] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:21.626370 14040 raft_consensus.cc:504] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.626536 14040 leader_election.cc:288] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565), ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455)
I20260929 22:45:21.626787 13671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dc4fa4e070942458fd4978af3ee947a" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410e1aa7f1494ab89d20a706f3553f1b" is_pre_election: true
I20260929 22:45:21.626801 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dc4fa4e070942458fd4978af3ee947a" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee63399a8009471d80796c9e0e715d6f" is_pre_election: true
I20260929 22:45:21.626879 13671 raft_consensus.cc:2454] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 0.
I20260929 22:45:21.626916 13953 raft_consensus.cc:2454] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 0.
I20260929 22:45:21.627030 13744 leader_election.cc:302] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 410e1aa7f1494ab89d20a706f3553f1b, bebd0d3b1c6a455c9f217ac1f2526a00; no voters:
I20260929 22:45:21.627120 14040 raft_consensus.cc:2781] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:21.627161 14040 raft_consensus.cc:482] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:21.627185 14040 raft_consensus.cc:3037] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.627910 14040 raft_consensus.cc:504] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.628078 14040 leader_election.cc:288] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 election: Requested vote from peers 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565), ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455)
I20260929 22:45:21.628201 13671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dc4fa4e070942458fd4978af3ee947a" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410e1aa7f1494ab89d20a706f3553f1b"
I20260929 22:45:21.628217 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dc4fa4e070942458fd4978af3ee947a" candidate_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee63399a8009471d80796c9e0e715d6f"
I20260929 22:45:21.628283 13953 raft_consensus.cc:3037] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.628285 13671 raft_consensus.cc:3037] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.628890 13953 raft_consensus.cc:2454] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 1.
I20260929 22:45:21.628902 13671 raft_consensus.cc:2454] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebd0d3b1c6a455c9f217ac1f2526a00 in term 1.
I20260929 22:45:21.629058 13746 leader_election.cc:302] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bebd0d3b1c6a455c9f217ac1f2526a00, ee63399a8009471d80796c9e0e715d6f; no voters:
I20260929 22:45:21.629153 14040 raft_consensus.cc:2781] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:21.629204 14040 raft_consensus.cc:686] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 LEADER]: Becoming Leader. State: Replica: bebd0d3b1c6a455c9f217ac1f2526a00, State: Running, Role: LEADER
I20260929 22:45:21.629252 14040 consensus_queue.cc:237] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } }
I20260929 22:45:21.629529 14032 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: TxnStatusTablet state changed. Reason: New leader bebd0d3b1c6a455c9f217ac1f2526a00. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.629626 14032 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:45:21.629777 14065 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 22:45:21.629972 14065 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 22:45:21.630074 13514 catalog_manager.cc:5495] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:21.636449 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.633969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41791 (local address 127.0.0.1:49536)
0929 22:45:21.634049 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.634061 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.634117 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.634259 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.634259 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.634260 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:21.634307 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.634309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.634920 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.634921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.635499 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.635501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.636010 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.636011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.636077 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.636098 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.636273 (+ 175us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.636280 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.636331 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.636375 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260929 22:45:21.636451 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.634022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49536 (local address 127.12.27.130:41791)
0929 22:45:21.634066 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.634069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.634095 (+ 26us) server_negotiation.cc:407] Connection header received
0929 22:45:21.634186 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.634187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.634197 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.634252 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:21.634356 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.634831 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.635585 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.635925 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.636009 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.636189 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.636226 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.636274 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.636336 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.636356 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:45:21.637358 13671 raft_consensus.cc:1261] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Refusing update from remote peer bebd0d3b1c6a455c9f217ac1f2526a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:21.637378 13953 raft_consensus.cc:1261] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Refusing update from remote peer bebd0d3b1c6a455c9f217ac1f2526a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:21.637591 14032 consensus_queue.cc:1035] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:21.637730 14040 consensus_queue.cc:1035] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:21.638341 14052 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: TxnStatusTablet state changed. Reason: New leader bebd0d3b1c6a455c9f217ac1f2526a00. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.638446 14052 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:21.638437 14028 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: TxnStatusTablet state changed. Reason: New leader bebd0d3b1c6a455c9f217ac1f2526a00. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.638516 14028 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:21.639201 14040 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.639285 14040 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:45:21.639386 14028 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.639465 14028 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P ee63399a8009471d80796c9e0e715d6f: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 22:45:21.640645 13860 tablet.cc:2369] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:21.643610 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.641056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57748 (local address 127.12.27.129:43565)
0929 22:45:21.641097 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.641099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.641106 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:21.641136 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.641137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.641152 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.641206 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:21.641339 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.641791 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.642831 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.643093 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.643171 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.643295 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.643409 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.643477 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.643544 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.643561 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:21.644174 14030 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.644286 14030 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P bebd0d3b1c6a455c9f217ac1f2526a00: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:45:21.644872 14052 tablet_replica.cc:439] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410e1aa7f1494ab89d20a706f3553f1b" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43565 } } peers { permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 } } peers { permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 } } }
I20260929 22:45:21.644969 14052 tablet_replica.cc:442] T 9dc4fa4e070942458fd4978af3ee947a P 410e1aa7f1494ab89d20a706f3553f1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:21.648653 14020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.646163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:33729 (local address 127.12.27.130:41791)
0929 22:45:21.646223 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.646224 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.646339 (+ 115us) server_negotiation.cc:407] Connection header received
0929 22:45:21.646398 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.646398 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.646407 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.646447 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:21.646565 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.646981 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.648061 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.648230 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.648281 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.648462 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.648485 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.648522 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.648595 (+ 73us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.648610 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:45:21.648945 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.646112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41791 (local address 127.12.27.129:33729)
0929 22:45:21.646270 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.646280 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.646342 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.646459 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.646459 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.646461 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:21.646513 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.646514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.647048 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.647049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.647985 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.647987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.648299 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.648299 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.648362 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.648376 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.648523 (+ 147us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.648524 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.648570 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.648606 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260929 22:45:21.650851 13953 raft_consensus.cc:1261] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Refusing update from remote peer 410e1aa7f1494ab89d20a706f3553f1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:21.650874 13812 raft_consensus.cc:3037] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:21.651103 14052 consensus_queue.cc:1035] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee63399a8009471d80796c9e0e715d6f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:21.651808 13812 raft_consensus.cc:1261] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Refusing update from remote peer 410e1aa7f1494ab89d20a706f3553f1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:21.652032 14052 consensus_queue.cc:1035] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bebd0d3b1c6a455c9f217ac1f2526a00" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:21.659219 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.656765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:40667 (local address 127.12.27.129:43565)
0929 22:45:21.656808 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.656811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.656888 (+ 77us) server_negotiation.cc:407] Connection header received
0929 22:45:21.656959 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.656960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.656968 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.657005 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:21.657123 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.657560 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.658650 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.658823 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.658875 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.659045 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.659069 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.659105 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.659157 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.659172 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:45:21.659274 14077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.656680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43565 (local address 127.12.27.130:40667)
0929 22:45:21.656833 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:21.656844 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:21.656903 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:21.657017 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:21.657018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:21.657019 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:21.657070 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.657071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.657626 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.657627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.658568 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:21.658571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.658892 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.658893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:21.658954 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.658968 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:21.659106 (+ 138us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:21.659107 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:45:21.659156 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:45:21.659197 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":93,"threads_started":1}
I20260929 22:45:21.668684 13514 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:21.668794 13514 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:21.669401 13514 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 524b6b18bbad4f7ca1fe5eb756fc041f: Sending DeleteTablet for 3 replicas of tablet 81b76d9ea60245da9ad65c2b8dd3150b
I20260929 22:45:21.669687 13651 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b76d9ea60245da9ad65c2b8dd3150b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:21 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:57736
I20260929 22:45:21.669771 14048 tablet_replica.cc:330] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: stopping tablet replica
I20260929 22:45:21.669813 14048 raft_consensus.cc:2229] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:21.669884 14048 raft_consensus.cc:2258] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:21.670184 14048 ts_tablet_manager.cc:1905] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:21.670513 13792 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b76d9ea60245da9ad65c2b8dd3150b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:21 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49526
I20260929 22:45:21.670598 14046 tablet_replica.cc:330] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: stopping tablet replica
I20260929 22:45:21.670645 14046 raft_consensus.cc:2229] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:21.670684 14046 raft_consensus.cc:2258] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:21.671028 14046 ts_tablet_manager.cc:1905] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:21.672567 13933 tablet_service.cc:1514] Processing DeleteTablet for tablet 81b76d9ea60245da9ad65c2b8dd3150b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:21 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:39952
I20260929 22:45:21.672662 14047 tablet_replica.cc:330] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: stopping tablet replica
I20260929 22:45:21.672710 14047 raft_consensus.cc:2229] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:21.672753 14047 raft_consensus.cc:2258] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:21.673105 14047 ts_tablet_manager.cc:1905] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:21.673969 14048 ts_tablet_manager.cc:1918] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:21.674019 14048 log.cc:1196] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/81b76d9ea60245da9ad65c2b8dd3150b
I20260929 22:45:21.674228 14048 ts_tablet_manager.cc:1939] T 81b76d9ea60245da9ad65c2b8dd3150b P 410e1aa7f1494ab89d20a706f3553f1b: Deleting consensus metadata
I20260929 22:45:21.674378 14046 ts_tablet_manager.cc:1918] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:21.674439 14046 log.cc:1196] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/81b76d9ea60245da9ad65c2b8dd3150b
I20260929 22:45:21.674633 14046 ts_tablet_manager.cc:1939] T 81b76d9ea60245da9ad65c2b8dd3150b P bebd0d3b1c6a455c9f217ac1f2526a00: Deleting consensus metadata
I20260929 22:45:21.674623 14047 ts_tablet_manager.cc:1918] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:21.674674 14047 log.cc:1196] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/81b76d9ea60245da9ad65c2b8dd3150b
I20260929 22:45:21.674882 14047 ts_tablet_manager.cc:1939] T 81b76d9ea60245da9ad65c2b8dd3150b P ee63399a8009471d80796c9e0e715d6f: Deleting consensus metadata
I20260929 22:45:21.674914 13498 catalog_manager.cc:4841] TS bebd0d3b1c6a455c9f217ac1f2526a00 (127.12.27.130:41791): tablet 81b76d9ea60245da9ad65c2b8dd3150b (table test-table [id=fedeb47bba9640b3b080a4857e01bbb1]) successfully deleted
I20260929 22:45:21.675169 13498 catalog_manager.cc:4841] TS 410e1aa7f1494ab89d20a706f3553f1b (127.12.27.129:43565): tablet 81b76d9ea60245da9ad65c2b8dd3150b (table test-table [id=fedeb47bba9640b3b080a4857e01bbb1]) successfully deleted
I20260929 22:45:21.675333 13500 catalog_manager.cc:4841] TS ee63399a8009471d80796c9e0e715d6f (127.12.27.131:43455): tablet 81b76d9ea60245da9ad65c2b8dd3150b (table test-table [id=fedeb47bba9640b3b080a4857e01bbb1]) successfully deleted
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[13468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:21.683617 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.670778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57754 (local address 127.12.27.129:43565)
0929 22:45:21.670817 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.670819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.670886 (+ 67us) server_negotiation.cc:407] Connection header received
0929 22:45:21.670987 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.670988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.670997 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.671026 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.671847 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.672570 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.676400 (+ 3830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.676695 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.676738 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.680303 (+ 3565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.680308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.680309 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.680316 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.682330 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.682746 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.682749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.682750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.682813 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.683030 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.683031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.683031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.683196 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.683344 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.683416 (+ 72us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.683492 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:45:21.683903 13712 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57754
I20260929 22:45:21.692230 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:21.684876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.12.27.190:37661)
0929 22:45:21.684917 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:21.684919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:21.685119 (+ 200us) server_negotiation.cc:407] Connection header received
0929 22:45:21.685152 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:21.685153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:21.685165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:21.685231 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:21.685862 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.686627 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.687656 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:21.687959 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:21.688030 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:21.689383 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:21.689385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:21.689385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:21.689392 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:21.691004 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.691377 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.691378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.691378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.691443 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:21.691716 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:21.691717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:21.691718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:21.691846 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:21.691952 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:21.692062 (+ 110us) server_negotiation.cc:299] Negotiation successful
0929 22:45:21.692137 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 22:45:21.692430 13514 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53082
I20260929 22:45:21.693091 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13586
I20260929 22:45:21.697957 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13727
I20260929 22:45:21.703361 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13868
I20260929 22:45:21.708437 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 13481
2026-09-29T22:45:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2205 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[14087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[14087](info): set up 2 sockets
Sep 29 22:45:21 dist-test-slave-00d6 krb5kdc[14087](info): commencing operation
krb5kdc: starting...
W20260929 22:45:22.739835 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:22 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:22.856518 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:36307
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:36307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:22.935546 14100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:22.935844 14100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:22.935884 14100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:22.937023 14100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:22.937088 14100 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 22:45:22.937108 14100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:22.937129 14100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:22.937150 14100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:22.937176 14100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:22.938668 14100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:36307
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:36307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:22.938941 14100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:22.939191 14100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:22.944079 14106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:22.944089 14108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:22.944089 14105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:22.944446 14100 server_base.cc:1034] running on GCE node
I20260929 22:45:22.944689 14100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:22.945026 14100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:22.946187 14100 hybrid_clock.cc:648] HybridClock initialized: now 1790721922946169 us; error 31 us; skew 500 ppm
Sep 29 22:45:22 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721922, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:22.953986 14100 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:22.954471 14100 webserver.cc:460] Webserver started at http://127.12.27.190:46485/ using document root <none> and password file <none>
I20260929 22:45:22.954715 14100 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:22.954783 14100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:22.954933 14100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:22.956101 14100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "0a78174a926841e69eda816531ed90eb"
format_stamp: "Formatted at 2026-09-29 22:45:22 on dist-test-slave-00d6"
server_key: "e5c5b7c6a69dcd396bf9441f9d99cc58"
server_key_iv: "f5c01a66efc68e902aeb4c599e93f62e"
server_key_version: "encryptionkey@0"
I20260929 22:45:22.956461 14100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "0a78174a926841e69eda816531ed90eb"
format_stamp: "Formatted at 2026-09-29 22:45:22 on dist-test-slave-00d6"
server_key: "e5c5b7c6a69dcd396bf9441f9d99cc58"
server_key_iv: "f5c01a66efc68e902aeb4c599e93f62e"
server_key_version: "encryptionkey@0"
I20260929 22:45:22.957762 14100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:22.958510 14115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:22.958689 14100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:22.958786 14100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "0a78174a926841e69eda816531ed90eb"
format_stamp: "Formatted at 2026-09-29 22:45:22 on dist-test-slave-00d6"
server_key: "e5c5b7c6a69dcd396bf9441f9d99cc58"
server_key_iv: "f5c01a66efc68e902aeb4c599e93f62e"
server_key_version: "encryptionkey@0"
I20260929 22:45:22.958863 14100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:22.974218 14100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:22.976155 14100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:22.976320 14100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:22.981042 14100 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:36307
I20260929 22:45:22.981102 14177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:36307 every 8 connection(s)
I20260929 22:45:22.981412 14100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:22.982023 14178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:22.984380 14178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Bootstrap starting.
I20260929 22:45:22.984972 14178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:22.985260 14178 log.cc:824] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:22.985925 14178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: No bootstrap required, opened a new log
I20260929 22:45:22.988085 14178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a78174a926841e69eda816531ed90eb" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36307 } }
I20260929 22:45:22.988220 14178 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:22.988242 14178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a78174a926841e69eda816531ed90eb, State: Initialized, Role: FOLLOWER
I20260929 22:45:22.988413 14178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a78174a926841e69eda816531ed90eb" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36307 } }
I20260929 22:45:22.988474 14178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:22.988497 14178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:22.988559 14178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:22.989089 14178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a78174a926841e69eda816531ed90eb" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36307 } }
I20260929 22:45:22.989197 14178 leader_election.cc:302] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a78174a926841e69eda816531ed90eb; no voters:
I20260929 22:45:22.989375 14178 leader_election.cc:288] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:22.989441 14181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:22.989601 14181 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [term 1 LEADER]: Becoming Leader. State: Replica: 0a78174a926841e69eda816531ed90eb, State: Running, Role: LEADER
I20260929 22:45:22.989627 14178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:22.989693 14181 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a78174a926841e69eda816531ed90eb" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36307 } }
I20260929 22:45:22.990077 14182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a78174a926841e69eda816531ed90eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a78174a926841e69eda816531ed90eb" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36307 } } }
I20260929 22:45:22.990110 14183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a78174a926841e69eda816531ed90eb. Latest consensus state: current_term: 1 leader_uuid: "0a78174a926841e69eda816531ed90eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a78174a926841e69eda816531ed90eb" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36307 } } }
I20260929 22:45:22.990264 14183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:22.990447 14190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:22.990638 14182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:22.990983 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 14100
I20260929 22:45:22.991067 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:22.991061 14190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:22.991267 12398 external_mini_cluster.cc:1428] Setting key cfef9dec8cb7e71341d36e35b7b3e672
I20260929 22:45:22.992842 14190 catalog_manager.cc:1347] Generated new cluster ID: 537d8e4506a44392a755aae2401fdca5
I20260929 22:45:22.992915 14190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:45:22 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:23.002523 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:22.991739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39676 (local address 127.12.27.190:36307)
0929 22:45:22.991941 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:22.991951 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:22.991980 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:45:22.992098 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:22.992104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:22.992146 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:22.992277 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:22.993095 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:22.994460 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:22.995496 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:22.996148 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:22.996260 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:22.998994 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:22.998997 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:22.998998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:22.999009 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.000901 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.001297 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.001300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.001300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.001422 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.001639 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.001640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.001640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.001914 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.002056 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.002179 (+ 123us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.002302 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":78,"threads_started":1}
I20260929 22:45:23.009263 14190 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:23.009989 14190 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:23.023262 14190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Generated new TSK 0
I20260929 22:45:23.023494 14190 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:23.052699 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36307
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:23.152467 14204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:23.152667 14204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:23.152691 14204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:23.153836 14204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:23.153875 14204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:23.153896 14204 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 22:45:23.153908 14204 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:45:23.153925 14204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:23.155364 14204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:23.155606 14204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:23.155857 14204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:23.160748 14209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:23.160760 14210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:23.160768 14212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:23.160914 14204 server_base.cc:1034] running on GCE node
I20260929 22:45:23.161242 14204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:23.161489 14204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:23.162680 14204 hybrid_clock.cc:648] HybridClock initialized: now 1790721923162658 us; error 38 us; skew 500 ppm
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:23.165143 14204 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:23.165558 14204 webserver.cc:460] Webserver started at http://127.12.27.129:36039/ using document root <none> and password file <none>
I20260929 22:45:23.165774 14204 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:23.165841 14204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:23.165988 14204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:23.166982 14204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "3e742dba3b9e428dbbdd13dbb2643713"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "c2453e956cd785a1714c6e192a7073ef"
server_key_iv: "2b95de9d95d746845dec4bdaa123ed4b"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.167335 14204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "3e742dba3b9e428dbbdd13dbb2643713"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "c2453e956cd785a1714c6e192a7073ef"
server_key_iv: "2b95de9d95d746845dec4bdaa123ed4b"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.168712 14204 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:23.169417 14219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.169603 14204 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.169703 14204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "3e742dba3b9e428dbbdd13dbb2643713"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "c2453e956cd785a1714c6e192a7073ef"
server_key_iv: "2b95de9d95d746845dec4bdaa123ed4b"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.169775 14204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:23.179586 14204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:23.181402 14204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:23.181559 14204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:23.182073 14204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:23.182133 14204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.182173 14204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:23.182200 14204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.189075 14204 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:43269
I20260929 22:45:23.189149 14335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:43269 every 8 connection(s)
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:23.189426 14204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:45:23.192534 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.182485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:50429 (local address 127.12.27.190:36307)
0929 22:45:23.182558 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.182560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.182753 (+ 193us) server_negotiation.cc:407] Connection header received
0929 22:45:23.183237 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.183238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.183250 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.183325 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.184283 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.185119 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.186739 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.187072 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.187139 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.189962 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.189963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.189963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.189970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.191365 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.191800 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.191801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.191801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.191849 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.192056 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.192056 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.192056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.192150 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.192198 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.192399 (+ 201us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.192472 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:45:23.192713 14228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.182465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.12.27.129:50429)
0929 22:45:23.182624 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.182660 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.183134 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.183445 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.183450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.183857 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.184162 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.184169 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.185235 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.185236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.186645 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.186647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.187168 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.187170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.187316 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.187979 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.187990 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.189884 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.191436 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.191442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.191444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.191739 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.191904 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.191905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.191905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.192005 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.192202 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.192206 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.192309 (+ 103us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.192380 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.192495 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":102,"threads_started":1}
I20260929 22:45:23.193286 14336 heartbeater.cc:347] Connected to a master server at 127.12.27.190:36307
I20260929 22:45:23.193365 14336 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:23.193562 14336 heartbeater.cc:511] Master 127.12.27.190:36307 requested a full tablet report, sending...
I20260929 22:45:23.194104 14132 ts_manager.cc:194] Registered new tserver with Master: 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269)
I20260929 22:45:23.194819 14132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:50429
I20260929 22:45:23.198167 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 14204
I20260929 22:45:23.198276 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:23.198446 12398 external_mini_cluster.cc:1428] Setting key e86f14bf46fdaf8b5b664433005a59c5
I20260929 22:45:23.199514 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.194388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:33423 (local address 127.12.27.190:36307)
0929 22:45:23.194432 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.194434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.194495 (+ 61us) server_negotiation.cc:407] Connection header received
0929 22:45:23.194562 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.194563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.194572 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.194625 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.194922 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.195455 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.196229 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.196427 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.196500 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.197266 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.197267 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.197268 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.197274 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.198398 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.198758 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.198759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.198759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.198811 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.199015 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.199016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.199017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.199129 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.199198 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.199356 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.199426 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:23.199532 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.194325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.12.27.129:33423)
0929 22:45:23.194443 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.194454 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.194508 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.194630 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.194631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.194800 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.194845 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.194846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.195564 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.195565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.196139 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.196141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.196498 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.196499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.196584 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.196925 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.196929 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.197182 (+ 253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.198484 (+ 1302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.198485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.198486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.198704 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.198886 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.198887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.198888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.198945 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.199201 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.199203 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.199246 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.199331 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.199428 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:23.220477 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36307
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:23.299754 14345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:23.299948 14345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:23.299973 14345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:23.301101 14345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:23.301141 14345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:23.301172 14345 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 22:45:23.301229 14345 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:45:23.301254 14345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:23.302680 14345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:23.302920 14345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:23.303150 14345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:23.308158 14351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:23.308166 14353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:23.308156 14350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:23.308183 14345 server_base.cc:1034] running on GCE node
I20260929 22:45:23.308506 14345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:23.308755 14345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:23.309912 14345 hybrid_clock.cc:648] HybridClock initialized: now 1790721923309904 us; error 30 us; skew 500 ppm
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:23.312306 14345 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:23.312772 14345 webserver.cc:460] Webserver started at http://127.12.27.130:40841/ using document root <none> and password file <none>
I20260929 22:45:23.313060 14345 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:23.313127 14345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:23.313269 14345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:23.314271 14345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "19db16e3cdec4c4da16de766caf28392"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "48b6960450267fd02cbd15d3d35df0c2"
server_key_iv: "b5f7e2d41546876f364c39b6328a1146"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.314625 14345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "19db16e3cdec4c4da16de766caf28392"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "48b6960450267fd02cbd15d3d35df0c2"
server_key_iv: "b5f7e2d41546876f364c39b6328a1146"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.315955 14345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:23.316658 14360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.316817 14345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:23.316913 14345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "19db16e3cdec4c4da16de766caf28392"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "48b6960450267fd02cbd15d3d35df0c2"
server_key_iv: "b5f7e2d41546876f364c39b6328a1146"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.316989 14345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:23.334254 14345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:23.336199 14345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:23.336360 14345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:23.336928 14345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:23.336987 14345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.337018 14345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:23.337055 14345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:23.344290 14345 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:39897
I20260929 22:45:23.344367 14477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:39897 every 8 connection(s)
I20260929 22:45:23.344707 14345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:45:23.346396 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.337342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:47687 (local address 127.12.27.190:36307)
0929 22:45:23.337420 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.337422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.337629 (+ 207us) server_negotiation.cc:407] Connection header received
0929 22:45:23.338185 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.338187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.338200 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.338272 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.339009 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.339877 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.341015 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.341366 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.341453 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.343683 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.343685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.343685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.343692 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.345352 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.345696 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.345697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.345697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.345746 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.345908 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.345909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.345909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.346005 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.346076 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.346278 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.346335 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:45:23.346589 14369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.337337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.12.27.130:47687)
0929 22:45:23.337503 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.337538 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.338065 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.338389 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.338393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.338669 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.338849 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.338854 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.339993 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.339994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.340905 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.340908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.341496 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.341497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.341633 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.342144 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.342168 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.343569 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.345420 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.345424 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.345426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.345632 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.345784 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.345784 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.345785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.345861 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.346070 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.346073 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.346176 (+ 103us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.346252 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.346359 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260929 22:45:23.347048 14478 heartbeater.cc:347] Connected to a master server at 127.12.27.190:36307
I20260929 22:45:23.347121 14478 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:23.347293 14478 heartbeater.cc:511] Master 127.12.27.190:36307 requested a full tablet report, sending...
I20260929 22:45:23.347682 14131 ts_manager.cc:194] Registered new tserver with Master: 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897)
I20260929 22:45:23.348075 14131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:47687
I20260929 22:45:23.353251 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.348131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:36351 (local address 127.12.27.190:36307)
0929 22:45:23.348255 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.348257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.348265 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:23.348316 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.348317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.348326 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.348378 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.348702 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.349153 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.349826 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.350032 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.350110 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.350871 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.350872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.350872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.350879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.352158 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.352485 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.352486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.352487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.352541 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.352731 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.352732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.352732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.352867 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.352952 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.353098 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.353168 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260929 22:45:23.353276 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.348042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.12.27.130:36351)
0929 22:45:23.348200 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.348212 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.348257 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.348384 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.348385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.348566 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.348619 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.348621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.349241 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.349242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.349744 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.349746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.350112 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.350113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.350183 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.350537 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.350541 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.350785 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.352251 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.352252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.352252 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.352415 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.352604 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.352605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.352605 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.352661 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.352946 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.352946 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.352990 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.353075 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.353169 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
I20260929 22:45:23.354828 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 14345
I20260929 22:45:23.354939 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:23.355119 12398 external_mini_cluster.cc:1428] Setting key 629cbc2e7a0c55fa06973ff9f977dae8
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:23.379046 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36307
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:23.457764 14487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:23.457959 14487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:23.457983 14487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:23.459069 14487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:23.459102 14487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:23.459123 14487 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 22:45:23.459136 14487 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:45:23.459151 14487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:23.460645 14487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:23.460860 14487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:23.461059 14487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:23.466106 14493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:23.466115 14492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:23.466115 14495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:23.466344 14487 server_base.cc:1034] running on GCE node
I20260929 22:45:23.466535 14487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:23.466725 14487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:23.467856 14487 hybrid_clock.cc:648] HybridClock initialized: now 1790721923467843 us; error 27 us; skew 500 ppm
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:23.470180 14487 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:23.470621 14487 webserver.cc:460] Webserver started at http://127.12.27.131:41879/ using document root <none> and password file <none>
I20260929 22:45:23.470837 14487 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:23.470901 14487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:23.471042 14487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:23.472074 14487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "723e0e2bea7444c88e789921e2b7415d"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "e3724ce2f4a5912d687e9a10eeba5207"
server_key_iv: "54c655b69fd3d1c982f3a9d19daa27a0"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.472410 14487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "723e0e2bea7444c88e789921e2b7415d"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "e3724ce2f4a5912d687e9a10eeba5207"
server_key_iv: "54c655b69fd3d1c982f3a9d19daa27a0"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.473722 14487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:23.474368 14502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.474562 14487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.474653 14487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "723e0e2bea7444c88e789921e2b7415d"
format_stamp: "Formatted at 2026-09-29 22:45:23 on dist-test-slave-00d6"
server_key: "e3724ce2f4a5912d687e9a10eeba5207"
server_key_iv: "54c655b69fd3d1c982f3a9d19daa27a0"
server_key_version: "encryptionkey@0"
I20260929 22:45:23.474726 14487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:23.493582 14487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:23.495514 14487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:23.495721 14487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:23.496282 14487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:23.496340 14487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.496371 14487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:23.496392 14487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:23.503194 14487 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:36577
I20260929 22:45:23.503597 14487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:23.503675 14617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:36577 every 8 connection(s)
I20260929 22:45:23.505806 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.496609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:60185 (local address 127.12.27.190:36307)
0929 22:45:23.496665 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.496667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.496846 (+ 179us) server_negotiation.cc:407] Connection header received
0929 22:45:23.497381 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.497383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.497397 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.497450 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.498096 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.498911 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.500168 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.500379 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.500468 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.502741 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.502743 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.502743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.502751 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.504452 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.504869 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.504870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.504871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.504930 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.505186 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.505187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.505188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.505302 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.505375 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.505636 (+ 261us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.505718 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:45:23.505975 14511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.496590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.12.27.131:60185)
0929 22:45:23.496730 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.496766 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.497266 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.497523 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.497527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.497825 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.498002 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.498006 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.499002 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.499003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.500077 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.500079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.500491 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.500492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.500603 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.501112 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.501129 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.502629 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.504553 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.504559 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.504562 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.504775 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.504994 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.504995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.504995 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.505112 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.505365 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.505371 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.505504 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.505612 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.505760 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
I20260929 22:45:23.506474 14618 heartbeater.cc:347] Connected to a master server at 127.12.27.190:36307
I20260929 22:45:23.506556 14618 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:23.506724 14618 heartbeater.cc:511] Master 127.12.27.190:36307 requested a full tablet report, sending...
I20260929 22:45:23.507150 14132 ts_manager.cc:194] Registered new tserver with Master: 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:23.507616 14132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:60185
I20260929 22:45:23.512550 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.507497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:50857 (local address 127.12.27.190:36307)
0929 22:45:23.507535 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.507537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.507674 (+ 137us) server_negotiation.cc:407] Connection header received
0929 22:45:23.507777 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.507778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.507789 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.507839 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.508181 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.508721 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.509370 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.509542 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.509590 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.510341 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.510342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.510342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.510347 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.511724 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.512046 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.512047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.512047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.512094 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.512224 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.512224 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.512224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.512302 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.512344 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.512437 (+ 93us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.512490 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:45:23.512571 14624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.507443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.12.27.131:50857)
0929 22:45:23.507585 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.507597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.507697 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.507856 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.507857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.508050 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.508109 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.508110 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.508814 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.508815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.509303 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.509304 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.509602 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.509603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.509659 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.510001 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.510005 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.510270 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.511812 (+ 1542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.511813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.511814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.511976 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.512134 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.512134 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.512134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.512177 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.512335 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.512335 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.512368 (+ 33us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.512423 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.512506 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":64,"threads_started":1}
I20260929 22:45:23.513612 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 14487
I20260929 22:45:23.513710 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:23.513875 12398 external_mini_cluster.cc:1428] Setting key c95866c8de8fbb074254b03ac490782d
I20260929 22:45:23.514670 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:23.536242 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.529699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.12.27.190:36307)
0929 22:45:23.529764 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.529765 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.529774 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:23.529796 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.529807 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.529819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.529876 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.530444 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.530920 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.531677 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.531857 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.531909 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.534180 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.534181 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.534182 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.534188 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.535296 (+ 1108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.535593 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.535594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.535594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.535684 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.535870 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.535870 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.535871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.535965 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.536039 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.536122 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.536176 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:45:23.537918 14132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:23.539520 14132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:23.545977 14640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.542187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43094 (local address 127.12.27.130:39897)
0929 22:45:23.542360 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.542364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.542374 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:23.542421 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.542423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.542435 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.542536 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:23.542749 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.543417 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.544985 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.545515 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.545614 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.545674 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.545837 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.545874 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":112,"threads_started":1}
I20260929 22:45:23.545965 14635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.541956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:39897 (local address 127.0.0.1:43094)
0929 22:45:23.542174 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.542182 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.542219 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.542600 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.542601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.542603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:23.542669 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.542671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.543515 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.543516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.544881 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.544884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.545617 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.545618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.545704 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.545718 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.545819 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.545874 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":72,"threads_started":1}
I20260929 22:45:23.546092 14639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.541772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.0.0.1:51874)
0929 22:45:23.542066 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.542083 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.542152 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.542507 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.542509 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.542510 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:23.542537 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.542538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.543842 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.543843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.545004 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.545006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.545892 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.545893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.545952 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.545954 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.545982 (+ 28us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.546015 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":34,"thread_start_us":48,"threads_started":1}
I20260929 22:45:23.546387 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.541875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53054 (local address 127.12.27.131:36577)
0929 22:45:23.542204 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.542208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.542220 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:45:23.542259 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.542261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.542277 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.542350 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:23.542624 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.543755 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.544932 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.545654 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.545726 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.545779 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.546252 (+ 473us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.546296 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":84,"threads_started":1}
I20260929 22:45:23.546496 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.541891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51874 (local address 127.12.27.129:43269)
0929 22:45:23.542347 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.542351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.542360 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:23.542396 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.542398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.542413 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.542612 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:23.542676 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.543771 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.545083 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.545805 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.546268 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.546334 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.546360 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.546400 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":77,"threads_started":1}
I20260929 22:45:23.546528 14636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.541772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36577 (local address 127.0.0.1:53054)
0929 22:45:23.541948 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.541993 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.542074 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.542451 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.542454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.542456 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:23.542522 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.542538 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.543851 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.543852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.544841 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.544843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.545817 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.545818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.545887 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.545891 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.545935 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.545979 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":35,"thread_start_us":96,"threads_started":1}
I20260929 22:45:23.546689 14410 tablet_service.cc:1467] Processing CreateTablet for tablet d21f2f0e3ef8473ba26960f0fd086c9b (DEFAULT_TABLE table=test-table [id=7d93a88322054b7faae35b3d5008987f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:23.547061 14410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d21f2f0e3ef8473ba26960f0fd086c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.547214 14552 tablet_service.cc:1467] Processing CreateTablet for tablet d21f2f0e3ef8473ba26960f0fd086c9b (DEFAULT_TABLE table=test-table [id=7d93a88322054b7faae35b3d5008987f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:23.547317 14270 tablet_service.cc:1467] Processing CreateTablet for tablet d21f2f0e3ef8473ba26960f0fd086c9b (DEFAULT_TABLE table=test-table [id=7d93a88322054b7faae35b3d5008987f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:23.547538 14552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d21f2f0e3ef8473ba26960f0fd086c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.547573 14270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d21f2f0e3ef8473ba26960f0fd086c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.550647 14642 tablet_bootstrap.cc:492] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Bootstrap starting.
I20260929 22:45:23.550798 14643 tablet_bootstrap.cc:492] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Bootstrap starting.
I20260929 22:45:23.551323 14643 tablet_bootstrap.cc:654] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.551549 14642 tablet_bootstrap.cc:654] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.551669 14643 log.cc:824] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:23.551766 14641 tablet_bootstrap.cc:492] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Bootstrap starting.
I20260929 22:45:23.551913 14642 log.cc:824] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:23.552380 14641 tablet_bootstrap.cc:654] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.552636 14643 tablet_bootstrap.cc:492] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: No bootstrap required, opened a new log
I20260929 22:45:23.552665 14642 tablet_bootstrap.cc:492] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: No bootstrap required, opened a new log
I20260929 22:45:23.552711 14643 ts_tablet_manager.cc:1397] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:23.552722 14642 ts_tablet_manager.cc:1397] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:45:23.552711 14641 log.cc:824] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:23.553391 14641 tablet_bootstrap.cc:492] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: No bootstrap required, opened a new log
I20260929 22:45:23.553467 14641 ts_tablet_manager.cc:1397] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:23.554252 14643 raft_consensus.cc:348] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.554404 14643 raft_consensus.cc:374] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.554448 14643 raft_consensus.cc:729] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db16e3cdec4c4da16de766caf28392, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.554567 14643 consensus_queue.cc:260] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.554844 14643 ts_tablet_manager.cc:1428] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:45:23.554754 14642 raft_consensus.cc:348] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.554900 14642 raft_consensus.cc:374] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.554940 14642 raft_consensus.cc:729] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 723e0e2bea7444c88e789921e2b7415d, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.555069 14642 consensus_queue.cc:260] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.555332 14642 ts_tablet_manager.cc:1428] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:45:23.555378 14618 heartbeater.cc:503] Master 127.12.27.190:36307 was elected leader, sending a full tablet report...
I20260929 22:45:23.555446 14478 heartbeater.cc:503] Master 127.12.27.190:36307 was elected leader, sending a full tablet report...
I20260929 22:45:23.555416 14641 raft_consensus.cc:348] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.555583 14641 raft_consensus.cc:374] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.555650 14641 raft_consensus.cc:729] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.555766 14641 consensus_queue.cc:260] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.556037 14641 ts_tablet_manager.cc:1428] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:23.556126 14336 heartbeater.cc:503] Master 127.12.27.190:36307 was elected leader, sending a full tablet report...
W20260929 22:45:23.595299 14479 tablet.cc:2369] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:23.669229 14649 raft_consensus.cc:482] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:23.669373 14649 raft_consensus.cc:504] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.669726 14649 leader_election.cc:288] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577), 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897)
I20260929 22:45:23.673257 14640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.669947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:48861 (local address 127.12.27.130:39897)
0929 22:45:23.669990 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.669992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.670001 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:23.670079 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.670080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.670090 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.670144 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:23.670309 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.670831 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.672350 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.672908 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.672984 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.672994 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.673166 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.673200 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:45:23.673252 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.669975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:45335 (local address 127.12.27.131:36577)
0929 22:45:23.670014 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.670016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.670143 (+ 127us) server_negotiation.cc:407] Connection header received
0929 22:45:23.670171 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.670172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.670181 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.670243 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:23.670410 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.670841 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.672350 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.672906 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.672999 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.673006 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.673152 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.673185 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:45:23.673262 14228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.669886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:39897 (local address 127.12.27.129:48861)
0929 22:45:23.669941 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.669953 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.669996 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.670159 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.670160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.670162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:23.670236 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.670238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.670937 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.670938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.672264 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.672267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.672989 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.672990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.673085 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.673088 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.673141 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.673168 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":49}
I20260929 22:45:23.673270 14650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.669915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36577 (local address 127.12.27.129:45335)
0929 22:45:23.670053 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.670063 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.670119 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.670252 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.670252 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.670254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:23.670345 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.670346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.670942 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.670942 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.672264 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.672267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.672990 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.672990 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.673063 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.673068 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.673126 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.673166 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":101,"thread_start_us":60,"threads_started":1}
I20260929 22:45:23.673671 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21f2f0e3ef8473ba26960f0fd086c9b" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392" is_pre_election: true
I20260929 22:45:23.673672 14572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21f2f0e3ef8473ba26960f0fd086c9b" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d" is_pre_election: true
I20260929 22:45:23.673817 14572 raft_consensus.cc:2454] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 0.
I20260929 22:45:23.673817 14416 raft_consensus.cc:2454] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 0.
I20260929 22:45:23.674034 14221 leader_election.cc:302] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db16e3cdec4c4da16de766caf28392, 3e742dba3b9e428dbbdd13dbb2643713; no voters:
I20260929 22:45:23.674170 14649 raft_consensus.cc:2781] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:23.674227 14649 raft_consensus.cc:482] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:23.674256 14649 raft_consensus.cc:3037] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.674885 14649 raft_consensus.cc:504] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.675016 14649 leader_election.cc:288] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 election: Requested vote from peers 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577), 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897)
I20260929 22:45:23.675159 14572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21f2f0e3ef8473ba26960f0fd086c9b" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d"
I20260929 22:45:23.675192 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21f2f0e3ef8473ba26960f0fd086c9b" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392"
I20260929 22:45:23.675237 14572 raft_consensus.cc:3037] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.675288 14416 raft_consensus.cc:3037] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.676008 14572 raft_consensus.cc:2454] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 1.
I20260929 22:45:23.676086 14416 raft_consensus.cc:2454] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 1.
I20260929 22:45:23.676194 14220 leader_election.cc:302] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e742dba3b9e428dbbdd13dbb2643713, 723e0e2bea7444c88e789921e2b7415d; no voters:
I20260929 22:45:23.676285 14649 raft_consensus.cc:2781] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:23.676416 14649 raft_consensus.cc:686] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 LEADER]: Becoming Leader. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Running, Role: LEADER
I20260929 22:45:23.676529 14649 consensus_queue.cc:237] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } }
I20260929 22:45:23.677413 14131 catalog_manager.cc:5495] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } health_report { overall_health: UNKNOWN } } }
W20260929 22:45:23.690125 14337 tablet.cc:2369] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 22:45:23 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721922, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:23.706928 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.700312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39696 (local address 127.12.27.190:36307)
0929 22:45:23.700375 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.700377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.700489 (+ 112us) server_negotiation.cc:407] Connection header received
0929 22:45:23.700598 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.700598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.700615 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.700675 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:23.701127 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.701614 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.702284 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.702466 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.702539 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.704551 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:23.704552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:23.704552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:23.704559 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:23.705797 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.706186 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.706187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.706187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.706257 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:23.706452 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:23.706453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:23.706453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:23.706556 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:23.706636 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.706761 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.706862 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":37}
I20260929 22:45:23.706904 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.700274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36307 (local address 127.0.0.1:39696)
0929 22:45:23.700423 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.700432 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.700509 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.700679 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.700680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.700988 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:23.701036 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.701038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.701691 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.701692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.702206 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.702207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.702539 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.702540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.702597 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.703129 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:23.703134 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:23.704470 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:23.705874 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.705881 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.705883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.706121 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.706324 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:23.706325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:23.706325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:23.706396 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:23.706633 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:23.706638 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:23.706679 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.706731 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.706817 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
I20260929 22:45:23.708814 14131 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:39696:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 22:45:23.708989 14131 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:23.710353 14270 tablet_service.cc:1467] Processing CreateTablet for tablet 5a47a43111ab468180d57ea749c2c29d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ed08cacb46eb4ec2bd6bfbf58696fbe4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:45:23.710388 14410 tablet_service.cc:1467] Processing CreateTablet for tablet 5a47a43111ab468180d57ea749c2c29d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ed08cacb46eb4ec2bd6bfbf58696fbe4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:45:23.710386 14552 tablet_service.cc:1467] Processing CreateTablet for tablet 5a47a43111ab468180d57ea749c2c29d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ed08cacb46eb4ec2bd6bfbf58696fbe4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:45:23.710513 14270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a47a43111ab468180d57ea749c2c29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.710527 14552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a47a43111ab468180d57ea749c2c29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.710513 14410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a47a43111ab468180d57ea749c2c29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.711539 14642 tablet_bootstrap.cc:492] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: Bootstrap starting.
I20260929 22:45:23.711961 14641 tablet_bootstrap.cc:492] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: Bootstrap starting.
I20260929 22:45:23.712087 14642 tablet_bootstrap.cc:654] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.712199 14643 tablet_bootstrap.cc:492] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: Bootstrap starting.
I20260929 22:45:23.712653 14641 tablet_bootstrap.cc:654] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.712920 14643 tablet_bootstrap.cc:654] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.712978 14642 tablet_bootstrap.cc:492] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: No bootstrap required, opened a new log
I20260929 22:45:23.713032 14642 ts_tablet_manager.cc:1397] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:23.713181 14642 raft_consensus.cc:348] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.713275 14642 raft_consensus.cc:374] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.713301 14642 raft_consensus.cc:729] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 723e0e2bea7444c88e789921e2b7415d, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.713340 14642 consensus_queue.cc:260] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.713452 14642 ts_tablet_manager.cc:1428] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:23.713534 14648 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.713645 14648 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.713696 14641 tablet_bootstrap.cc:492] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: No bootstrap required, opened a new log
I20260929 22:45:23.713744 14641 ts_tablet_manager.cc:1397] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:23.713864 14643 tablet_bootstrap.cc:492] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: No bootstrap required, opened a new log
I20260929 22:45:23.713915 14643 ts_tablet_manager.cc:1397] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:23.713891 14641 raft_consensus.cc:348] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.713994 14641 raft_consensus.cc:374] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.714021 14641 raft_consensus.cc:729] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.714071 14641 consensus_queue.cc:260] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.714067 14643 raft_consensus.cc:348] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.714150 14643 raft_consensus.cc:374] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.714174 14643 raft_consensus.cc:729] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db16e3cdec4c4da16de766caf28392, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.714164 14641 ts_tablet_manager.cc:1428] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.714213 14643 consensus_queue.cc:260] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.714221 14649 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.714310 14643 ts_tablet_manager.cc:1428] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.714305 14649 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.714450 14647 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.714545 14647 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.740926 14649 raft_consensus.cc:482] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:23.741043 14649 raft_consensus.cc:504] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.741250 14649 leader_election.cc:288] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897), 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:23.741446 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a47a43111ab468180d57ea749c2c29d" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392" is_pre_election: true
I20260929 22:45:23.741459 14572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a47a43111ab468180d57ea749c2c29d" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d" is_pre_election: true
I20260929 22:45:23.741554 14416 raft_consensus.cc:2454] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 0.
I20260929 22:45:23.741554 14572 raft_consensus.cc:2454] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 0.
I20260929 22:45:23.741700 14220 leader_election.cc:302] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e742dba3b9e428dbbdd13dbb2643713, 723e0e2bea7444c88e789921e2b7415d; no voters:
I20260929 22:45:23.741788 14649 raft_consensus.cc:2781] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:23.741845 14649 raft_consensus.cc:482] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:23.741869 14649 raft_consensus.cc:3037] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.742497 14649 raft_consensus.cc:504] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.742653 14649 leader_election.cc:288] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 election: Requested vote from peers 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897), 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:23.742837 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a47a43111ab468180d57ea749c2c29d" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392"
I20260929 22:45:23.742859 14572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a47a43111ab468180d57ea749c2c29d" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d"
I20260929 22:45:23.742910 14416 raft_consensus.cc:3037] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.742923 14572 raft_consensus.cc:3037] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.743681 14416 raft_consensus.cc:2454] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 1.
I20260929 22:45:23.743682 14572 raft_consensus.cc:2454] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 1.
I20260929 22:45:23.743851 14220 leader_election.cc:302] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e742dba3b9e428dbbdd13dbb2643713, 723e0e2bea7444c88e789921e2b7415d; no voters:
I20260929 22:45:23.743979 14649 raft_consensus.cc:2781] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:23.744065 14649 raft_consensus.cc:686] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 LEADER]: Becoming Leader. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Running, Role: LEADER
I20260929 22:45:23.744119 14649 consensus_queue.cc:237] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.744417 14651 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: TxnStatusTablet state changed. Reason: New leader 3e742dba3b9e428dbbdd13dbb2643713. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.744509 14651 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:45:23.744728 14664 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 22:45:23.744724 14132 catalog_manager.cc:5495] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:23.744858 14664 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 22:45:23.751865 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.748997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.0.0.1:51884)
0929 22:45:23.749066 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.749079 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.749127 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.749305 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.749306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.749307 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:23.749352 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.749354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.750315 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.750316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.750867 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.750869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.751375 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.751375 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.751418 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.751432 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:23.751735 (+ 303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:23.751742 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.751773 (+ 31us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.751810 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:45:23.751881 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.749093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51884 (local address 127.12.27.129:43269)
0929 22:45:23.749149 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.749152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.749161 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:23.749197 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.749198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.749219 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.749308 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:23.749394 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.750236 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.750948 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.751294 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.751378 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.751516 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:23.751672 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:23.751762 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.751782 (+ 20us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.751804 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:45:23.753728 14416 raft_consensus.cc:1261] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Refusing update from remote peer 3e742dba3b9e428dbbdd13dbb2643713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:23.753728 14572 raft_consensus.cc:1261] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Refusing update from remote peer 3e742dba3b9e428dbbdd13dbb2643713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:23.754047 14651 consensus_queue.cc:1035] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:45:23.754108 14619 tablet.cc:2369] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:23.754335 14651 consensus_queue.cc:1035] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:23.755339 14648 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: TxnStatusTablet state changed. Reason: New leader 3e742dba3b9e428dbbdd13dbb2643713. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.755465 14648 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.755532 14647 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: TxnStatusTablet state changed. Reason: New leader 3e742dba3b9e428dbbdd13dbb2643713. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.755661 14647 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.756759 14651 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.756856 14651 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:45:23.756914 14667 mvcc.cc:205] Tried to move back new op lower bound from 7334796999693086720 to 7334796999656394752. Current Snapshot: MvccSnapshot[applied={T|T < 7334796999693086720}]
I20260929 22:45:23.756968 14647 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.757061 14647 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 19db16e3cdec4c4da16de766caf28392: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.756765 14649 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.757153 14649 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 3e742dba3b9e428dbbdd13dbb2643713: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:45:23.757346 14669 mvcc.cc:205] Tried to move back new op lower bound from 7334796999693086720 to 7334796999656394752. Current Snapshot: MvccSnapshot[applied={T|T < 7334796999693086720}]
I20260929 22:45:23.757719 14648 tablet_replica.cc:439] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } } }
I20260929 22:45:23.757802 14648 tablet_replica.cc:442] T 5a47a43111ab468180d57ea749c2c29d P 723e0e2bea7444c88e789921e2b7415d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:45:23.758491 14668 mvcc.cc:205] Tried to move back new op lower bound from 7334796999693086720 to 7334796999656394752. Current Snapshot: MvccSnapshot[applied={T|T < 7334796999693086720}]
I20260929 22:45:23.762460 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.759476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.12.27.129:43269)
0929 22:45:23.759523 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.759525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.759564 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:45:23.759660 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.759661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.759672 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.759730 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:23.759879 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.760697 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.761519 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.761873 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.761947 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.762046 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:23.762081 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:23.762133 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.762331 (+ 198us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.762352 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:45:23.767771 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.764964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42383 (local address 127.12.27.129:43269)
0929 22:45:23.765001 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:23.765003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:23.765140 (+ 137us) server_negotiation.cc:407] Connection header received
0929 22:45:23.765210 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:23.765210 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:23.765218 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:23.765257 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:23.765419 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.765836 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.767038 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.767207 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.767261 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.767492 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:23.767514 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:23.767553 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:23.767612 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 22:45:23.767681 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":18}
I20260929 22:45:23.767855 14679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:23.764886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.12.27.129:42383)
0929 22:45:23.765068 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:23.765078 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:23.765150 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:23.765270 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:23.765271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:23.765272 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:23.765363 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.765364 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.765906 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.765907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.766954 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:23.766957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:23.767300 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:23.767301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:23.767369 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:23.767386 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:23.767557 (+ 171us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:23.767558 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:45:23.767612 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:45:23.767682 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260929 22:45:23.769924 14416 raft_consensus.cc:1261] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Refusing update from remote peer 3e742dba3b9e428dbbdd13dbb2643713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:23.769942 14571 raft_consensus.cc:1261] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Refusing update from remote peer 3e742dba3b9e428dbbdd13dbb2643713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:23.770234 14649 consensus_queue.cc:1035] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:23.770467 14649 consensus_queue.cc:1035] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:23.784480 14132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:23.784585 14132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:23.785338 14132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Sending DeleteTablet for 3 replicas of tablet d21f2f0e3ef8473ba26960f0fd086c9b
I20260929 22:45:23.785665 14269 tablet_service.cc:1514] Processing DeleteTablet for tablet d21f2f0e3ef8473ba26960f0fd086c9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:23 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:51874
I20260929 22:45:23.785691 14410 tablet_service.cc:1514] Processing DeleteTablet for tablet d21f2f0e3ef8473ba26960f0fd086c9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:23 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:43094
I20260929 22:45:23.785846 14552 tablet_service.cc:1514] Processing DeleteTablet for tablet d21f2f0e3ef8473ba26960f0fd086c9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:23 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:53054
I20260929 22:45:23.785902 14683 tablet_replica.cc:330] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: stopping tablet replica
I20260929 22:45:23.785995 14683 raft_consensus.cc:2229] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:23.786062 14683 raft_consensus.cc:2258] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:23.786152 14685 tablet_replica.cc:330] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: stopping tablet replica
I20260929 22:45:23.786207 14684 tablet_replica.cc:330] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: stopping tablet replica
I20260929 22:45:23.786300 14684 raft_consensus.cc:2229] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:23.786394 14684 raft_consensus.cc:2258] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:23.786363 14132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:23.786525 14132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:23.786798 14685 raft_consensus.cc:2229] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:23.786868 14685 raft_consensus.cc:2258] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:23.786891 14683 ts_tablet_manager.cc:1905] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:23.787617 14552 tablet_service.cc:1467] Processing CreateTablet for tablet 061c88022cfd49d5880035468b51113f (DEFAULT_TABLE table=test-table [id=3b795d229c28483096b6ef4ac4ee8ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:23.787662 14410 tablet_service.cc:1467] Processing CreateTablet for tablet 061c88022cfd49d5880035468b51113f (DEFAULT_TABLE table=test-table [id=3b795d229c28483096b6ef4ac4ee8ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:23.787716 14269 tablet_service.cc:1467] Processing CreateTablet for tablet 061c88022cfd49d5880035468b51113f (DEFAULT_TABLE table=test-table [id=3b795d229c28483096b6ef4ac4ee8ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:23.787781 14552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061c88022cfd49d5880035468b51113f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.787779 14410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061c88022cfd49d5880035468b51113f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.787806 14269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061c88022cfd49d5880035468b51113f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:23.789121 14641 tablet_bootstrap.cc:492] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Bootstrap starting.
I20260929 22:45:23.789131 14643 tablet_bootstrap.cc:492] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Bootstrap starting.
I20260929 22:45:23.789202 14642 tablet_bootstrap.cc:492] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Bootstrap starting.
I20260929 22:45:23.789302 14684 ts_tablet_manager.cc:1905] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:23.789517 14643 tablet_bootstrap.cc:654] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.789517 14641 tablet_bootstrap.cc:654] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.789634 14642 tablet_bootstrap.cc:654] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:23.790149 14685 ts_tablet_manager.cc:1905] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:23.791078 14684 ts_tablet_manager.cc:1918] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:23.791193 14684 log.cc:1196] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/d21f2f0e3ef8473ba26960f0fd086c9b
I20260929 22:45:23.791455 14683 ts_tablet_manager.cc:1918] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:23.791536 14683 log.cc:1196] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/d21f2f0e3ef8473ba26960f0fd086c9b
I20260929 22:45:23.791690 14684 ts_tablet_manager.cc:1939] T d21f2f0e3ef8473ba26960f0fd086c9b P 3e742dba3b9e428dbbdd13dbb2643713: Deleting consensus metadata
I20260929 22:45:23.791797 14683 ts_tablet_manager.cc:1939] T d21f2f0e3ef8473ba26960f0fd086c9b P 19db16e3cdec4c4da16de766caf28392: Deleting consensus metadata
I20260929 22:45:23.791989 14685 ts_tablet_manager.cc:1918] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:23.792068 14685 log.cc:1196] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/d21f2f0e3ef8473ba26960f0fd086c9b
I20260929 22:45:23.792203 14117 catalog_manager.cc:4841] TS 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897): tablet d21f2f0e3ef8473ba26960f0fd086c9b (table test-table [id=7d93a88322054b7faae35b3d5008987f]) successfully deleted
I20260929 22:45:23.792333 14685 ts_tablet_manager.cc:1939] T d21f2f0e3ef8473ba26960f0fd086c9b P 723e0e2bea7444c88e789921e2b7415d: Deleting consensus metadata
I20260929 22:45:23.792352 14117 catalog_manager.cc:4841] TS 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269): tablet d21f2f0e3ef8473ba26960f0fd086c9b (table test-table [id=7d93a88322054b7faae35b3d5008987f]) successfully deleted
I20260929 22:45:23.792703 14641 tablet_bootstrap.cc:492] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: No bootstrap required, opened a new log
I20260929 22:45:23.792752 14641 ts_tablet_manager.cc:1397] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260929 22:45:23.792848 14116 catalog_manager.cc:4841] TS 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577): tablet d21f2f0e3ef8473ba26960f0fd086c9b (table test-table [id=7d93a88322054b7faae35b3d5008987f]) successfully deleted
I20260929 22:45:23.792903 14641 raft_consensus.cc:348] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.792990 14641 raft_consensus.cc:374] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.793015 14641 raft_consensus.cc:729] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.793061 14641 consensus_queue.cc:260] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.793169 14641 ts_tablet_manager.cc:1428] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.793315 14642 tablet_bootstrap.cc:492] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: No bootstrap required, opened a new log
I20260929 22:45:23.793362 14642 ts_tablet_manager.cc:1397] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260929 22:45:23.793501 14642 raft_consensus.cc:348] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.793574 14642 raft_consensus.cc:374] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.793603 14642 raft_consensus.cc:729] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 723e0e2bea7444c88e789921e2b7415d, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.793644 14642 consensus_queue.cc:260] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.793682 14643 tablet_bootstrap.cc:492] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: No bootstrap required, opened a new log
I20260929 22:45:23.793726 14643 ts_tablet_manager.cc:1397] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260929 22:45:23.793738 14642 ts_tablet_manager.cc:1428] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.793867 14643 raft_consensus.cc:348] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.793942 14643 raft_consensus.cc:374] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:23.793970 14643 raft_consensus.cc:729] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db16e3cdec4c4da16de766caf28392, State: Initialized, Role: FOLLOWER
I20260929 22:45:23.794009 14643 consensus_queue.cc:260] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.794135 14643 ts_tablet_manager.cc:1428] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:23.959774 14649 raft_consensus.cc:482] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:23.959877 14649 raft_consensus.cc:504] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.960080 14649 leader_election.cc:288] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897), 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:23.960316 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c88022cfd49d5880035468b51113f" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392" is_pre_election: true
I20260929 22:45:23.960317 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c88022cfd49d5880035468b51113f" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d" is_pre_election: true
I20260929 22:45:23.960417 14416 raft_consensus.cc:2454] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 0.
I20260929 22:45:23.960417 14571 raft_consensus.cc:2454] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 0.
I20260929 22:45:23.960594 14221 leader_election.cc:302] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db16e3cdec4c4da16de766caf28392, 3e742dba3b9e428dbbdd13dbb2643713; no voters:
I20260929 22:45:23.960719 14649 raft_consensus.cc:2781] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:23.960759 14649 raft_consensus.cc:482] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:23.960788 14649 raft_consensus.cc:3037] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.961761 14649 raft_consensus.cc:504] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.961899 14649 leader_election.cc:288] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 election: Requested vote from peers 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897), 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:23.962103 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c88022cfd49d5880035468b51113f" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392"
I20260929 22:45:23.962217 14416 raft_consensus.cc:3037] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.962227 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "061c88022cfd49d5880035468b51113f" candidate_uuid: "3e742dba3b9e428dbbdd13dbb2643713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d"
I20260929 22:45:23.962311 14571 raft_consensus.cc:3037] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:23.963045 14416 raft_consensus.cc:2454] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 1.
I20260929 22:45:23.963286 14221 leader_election.cc:302] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db16e3cdec4c4da16de766caf28392, 3e742dba3b9e428dbbdd13dbb2643713; no voters:
I20260929 22:45:23.963368 14649 raft_consensus.cc:2781] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:23.963415 14649 raft_consensus.cc:686] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 LEADER]: Becoming Leader. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Running, Role: LEADER
I20260929 22:45:23.963469 14649 consensus_queue.cc:237] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:23.963724 14571 raft_consensus.cc:2454] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e742dba3b9e428dbbdd13dbb2643713 in term 1.
I20260929 22:45:23.964099 14132 catalog_manager.cc:5495] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "3e742dba3b9e428dbbdd13dbb2643713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:23.974946 14416 raft_consensus.cc:1261] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Refusing update from remote peer 3e742dba3b9e428dbbdd13dbb2643713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:23.975111 14571 raft_consensus.cc:1261] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Refusing update from remote peer 3e742dba3b9e428dbbdd13dbb2643713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:23.975175 14651 consensus_queue.cc:1035] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:23.975271 14649 consensus_queue.cc:1035] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:45:23.980098 14667 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 22:45:25.498553 14132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:25.498651 14132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:25.499490 14132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Sending DeleteTablet for 3 replicas of tablet 061c88022cfd49d5880035468b51113f
I20260929 22:45:25.499809 14410 tablet_service.cc:1514] Processing DeleteTablet for tablet 061c88022cfd49d5880035468b51113f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:25 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:43094
I20260929 22:45:25.499809 14270 tablet_service.cc:1514] Processing DeleteTablet for tablet 061c88022cfd49d5880035468b51113f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:25 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:51874
I20260929 22:45:25.499814 14552 tablet_service.cc:1514] Processing DeleteTablet for tablet 061c88022cfd49d5880035468b51113f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:25 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:53054
I20260929 22:45:25.499991 14712 tablet_replica.cc:330] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: stopping tablet replica
I20260929 22:45:25.500059 14712 raft_consensus.cc:2229] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:25.500087 14712 raft_consensus.cc:2258] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:25.500185 14714 tablet_replica.cc:330] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: stopping tablet replica
I20260929 22:45:25.500234 14714 raft_consensus.cc:2229] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:25.500288 14714 raft_consensus.cc:2258] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:25.500357 14712 ts_tablet_manager.cc:1905] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:25.500494 14714 ts_tablet_manager.cc:1905] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:25.501955 14712 ts_tablet_manager.cc:1918] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:45:25.502020 14712 log.cc:1196] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/061c88022cfd49d5880035468b51113f
I20260929 22:45:25.502072 14714 ts_tablet_manager.cc:1918] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:45:25.502120 14714 log.cc:1196] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/061c88022cfd49d5880035468b51113f
I20260929 22:45:25.502251 14712 ts_tablet_manager.cc:1939] T 061c88022cfd49d5880035468b51113f P 19db16e3cdec4c4da16de766caf28392: Deleting consensus metadata
I20260929 22:45:25.502351 14714 ts_tablet_manager.cc:1939] T 061c88022cfd49d5880035468b51113f P 3e742dba3b9e428dbbdd13dbb2643713: Deleting consensus metadata
I20260929 22:45:25.502565 14713 tablet_replica.cc:330] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: stopping tablet replica
I20260929 22:45:25.502688 14713 raft_consensus.cc:2229] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:25.502781 14713 raft_consensus.cc:2258] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:25.502780 14117 catalog_manager.cc:4841] TS 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897): tablet 061c88022cfd49d5880035468b51113f (table test-table [id=3b795d229c28483096b6ef4ac4ee8ff9]) successfully deleted
I20260929 22:45:25.502856 14117 catalog_manager.cc:4841] TS 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269): tablet 061c88022cfd49d5880035468b51113f (table test-table [id=3b795d229c28483096b6ef4ac4ee8ff9]) successfully deleted
I20260929 22:45:25.503086 14713 ts_tablet_manager.cc:1905] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:25.507099 14713 ts_tablet_manager.cc:1918] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:45:25.507175 14713 log.cc:1196] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/061c88022cfd49d5880035468b51113f
I20260929 22:45:25.507426 14713 ts_tablet_manager.cc:1939] T 061c88022cfd49d5880035468b51113f P 723e0e2bea7444c88e789921e2b7415d: Deleting consensus metadata
I20260929 22:45:25.507838 14116 catalog_manager.cc:4841] TS 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577): tablet 061c88022cfd49d5880035468b51113f (table test-table [id=3b795d229c28483096b6ef4ac4ee8ff9]) successfully deleted
Sep 29 22:45:25 dist-test-slave-00d6 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721925, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:45:25 dist-test-slave-00d6 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721925, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:25.524124 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.517175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39710 (local address 127.12.27.190:36307)
0929 22:45:25.517347 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.517349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.517358 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:25.517399 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.517400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.517409 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.517469 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:25.518016 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.518527 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.519311 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.519530 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.519595 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.521848 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:25.521849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:25.521849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:25.521855 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:25.523136 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:25.523433 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:25.523434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:25.523434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:25.523482 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:25.523719 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:25.523720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:25.523724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:25.523824 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:25.523900 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.523986 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.524058 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260929 22:45:25.525525 14132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:25.525681 14132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:25.526988 14552 tablet_service.cc:1467] Processing CreateTablet for tablet f7f3f22e6b0f4149852e86efcfeeb2cb (DEFAULT_TABLE table=test-table [id=7347688b587c41b7a7ca5e443bc2b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:25.526989 14270 tablet_service.cc:1467] Processing CreateTablet for tablet f7f3f22e6b0f4149852e86efcfeeb2cb (DEFAULT_TABLE table=test-table [id=7347688b587c41b7a7ca5e443bc2b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:25.527045 14410 tablet_service.cc:1467] Processing CreateTablet for tablet f7f3f22e6b0f4149852e86efcfeeb2cb (DEFAULT_TABLE table=test-table [id=7347688b587c41b7a7ca5e443bc2b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:25.527122 14270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7f3f22e6b0f4149852e86efcfeeb2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:25.527120 14552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7f3f22e6b0f4149852e86efcfeeb2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:25.527189 14410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7f3f22e6b0f4149852e86efcfeeb2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:25.528283 14723 tablet_bootstrap.cc:492] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Bootstrap starting.
I20260929 22:45:25.528452 14724 tablet_bootstrap.cc:492] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Bootstrap starting.
I20260929 22:45:25.528716 14725 tablet_bootstrap.cc:492] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Bootstrap starting.
I20260929 22:45:25.528833 14724 tablet_bootstrap.cc:654] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:25.528863 14723 tablet_bootstrap.cc:654] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:25.529078 14725 tablet_bootstrap.cc:654] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:25.529464 14724 tablet_bootstrap.cc:492] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: No bootstrap required, opened a new log
I20260929 22:45:25.529536 14724 ts_tablet_manager.cc:1397] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:25.529667 14725 tablet_bootstrap.cc:492] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: No bootstrap required, opened a new log
I20260929 22:45:25.529719 14725 ts_tablet_manager.cc:1397] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:25.529676 14724 raft_consensus.cc:348] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.529747 14724 raft_consensus.cc:374] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:25.529778 14724 raft_consensus.cc:729] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 723e0e2bea7444c88e789921e2b7415d, State: Initialized, Role: FOLLOWER
I20260929 22:45:25.529829 14724 consensus_queue.cc:260] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.529816 14725 raft_consensus.cc:348] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.529876 14725 raft_consensus.cc:374] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:25.529911 14725 raft_consensus.cc:729] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Initialized, Role: FOLLOWER
I20260929 22:45:25.529990 14724 ts_tablet_manager.cc:1428] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:25.529966 14725 consensus_queue.cc:260] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.530081 14725 ts_tablet_manager.cc:1428] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:25.530313 14723 tablet_bootstrap.cc:492] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: No bootstrap required, opened a new log
I20260929 22:45:25.530366 14723 ts_tablet_manager.cc:1397] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:25.530534 14723 raft_consensus.cc:348] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.530616 14723 raft_consensus.cc:374] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:25.530642 14723 raft_consensus.cc:729] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db16e3cdec4c4da16de766caf28392, State: Initialized, Role: FOLLOWER
I20260929 22:45:25.530699 14723 consensus_queue.cc:260] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.530886 14723 ts_tablet_manager.cc:1428] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:25.780149 14730 raft_consensus.cc:482] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:25.780252 14730 raft_consensus.cc:504] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.780627 14730 leader_election.cc:288] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269), 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:25.783771 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.780901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:37631 (local address 127.12.27.129:43269)
0929 22:45:25.781056 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.781058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.781108 (+ 50us) server_negotiation.cc:407] Connection header received
0929 22:45:25.781176 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.781177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.781189 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.781275 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:25.781446 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.781982 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.783036 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.783406 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.783464 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.783500 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.783653 (+ 153us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.783691 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260929 22:45:25.783807 14732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.780820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36577 (local address 127.12.27.130:47945)
0929 22:45:25.781143 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.781154 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.781239 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.781418 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.781419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.781421 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:25.781471 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.781472 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.782141 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.782142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.782943 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.782945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.783524 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.783525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.783577 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.783580 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.783667 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.783702 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":6,"thread_start_us":118,"threads_started":1}
I20260929 22:45:25.783823 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.780820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.12.27.130:37631)
0929 22:45:25.781014 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.781037 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.781105 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.781292 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.781293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.781296 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:25.781363 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.781366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.782072 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.782073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.782941 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.782943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.783490 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.783491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.783550 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.783554 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.783605 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.783679 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":66,"thread_start_us":119,"threads_started":1}
I20260929 22:45:25.783808 14734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.780905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:47945 (local address 127.12.27.131:36577)
0929 22:45:25.781106 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.781108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.781235 (+ 127us) server_negotiation.cc:407] Connection header received
0929 22:45:25.781294 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.781296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.781306 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.781378 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:25.781553 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.782061 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.783050 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.783416 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.783505 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.783514 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.783683 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.783724 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":108,"threads_started":1}
I20260929 22:45:25.784014 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f3f22e6b0f4149852e86efcfeeb2cb" candidate_uuid: "19db16e3cdec4c4da16de766caf28392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d" is_pre_election: true
I20260929 22:45:25.784128 14571 raft_consensus.cc:2454] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db16e3cdec4c4da16de766caf28392 in term 0.
I20260929 22:45:25.784235 14290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f3f22e6b0f4149852e86efcfeeb2cb" candidate_uuid: "19db16e3cdec4c4da16de766caf28392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e742dba3b9e428dbbdd13dbb2643713" is_pre_election: true
I20260929 22:45:25.784329 14361 leader_election.cc:302] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db16e3cdec4c4da16de766caf28392, 723e0e2bea7444c88e789921e2b7415d; no voters:
I20260929 22:45:25.784389 14290 raft_consensus.cc:2454] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19db16e3cdec4c4da16de766caf28392 in term 0.
I20260929 22:45:25.784483 14730 raft_consensus.cc:2781] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:25.784546 14730 raft_consensus.cc:482] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:25.784578 14730 raft_consensus.cc:3037] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:25.785267 14730 raft_consensus.cc:504] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.785414 14730 leader_election.cc:288] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [CANDIDATE]: Term 1 election: Requested vote from peers 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269), 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577)
I20260929 22:45:25.785542 14290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f3f22e6b0f4149852e86efcfeeb2cb" candidate_uuid: "19db16e3cdec4c4da16de766caf28392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e742dba3b9e428dbbdd13dbb2643713"
I20260929 22:45:25.785586 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f3f22e6b0f4149852e86efcfeeb2cb" candidate_uuid: "19db16e3cdec4c4da16de766caf28392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e0e2bea7444c88e789921e2b7415d"
I20260929 22:45:25.785637 14290 raft_consensus.cc:3037] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:25.785660 14571 raft_consensus.cc:3037] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:25.786360 14290 raft_consensus.cc:2454] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db16e3cdec4c4da16de766caf28392 in term 1.
I20260929 22:45:25.786370 14571 raft_consensus.cc:2454] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19db16e3cdec4c4da16de766caf28392 in term 1.
I20260929 22:45:25.786528 14362 leader_election.cc:302] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19db16e3cdec4c4da16de766caf28392, 3e742dba3b9e428dbbdd13dbb2643713; no voters:
I20260929 22:45:25.786633 14730 raft_consensus.cc:2781] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:25.786785 14730 raft_consensus.cc:686] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 1 LEADER]: Becoming Leader. State: Replica: 19db16e3cdec4c4da16de766caf28392, State: Running, Role: LEADER
I20260929 22:45:25.786865 14730 consensus_queue.cc:237] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.787601 14131 catalog_manager.cc:5495] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19db16e3cdec4c4da16de766caf28392 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "19db16e3cdec4c4da16de766caf28392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:25.815464 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.813221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43102 (local address 127.12.27.130:39897)
0929 22:45:25.813377 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.813379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.813386 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:25.813422 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.813422 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.813440 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.813529 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:25.813634 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.814101 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.814811 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.815010 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.815059 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.815179 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.815279 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.815329 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.815368 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.815383 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":101,"threads_started":1}
I20260929 22:45:25.820277 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.817704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.12.27.130:46037)
0929 22:45:25.817895 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.817905 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.817981 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.818109 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.818109 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.818111 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:25.818168 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.818169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.818791 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.818792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.819436 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.819438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.819826 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.819827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.819898 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.819910 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.820107 (+ 197us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.820109 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.820149 (+ 40us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.820195 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
I20260929 22:45:25.820264 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.817791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:46037 (local address 127.12.27.129:43269)
0929 22:45:25.817860 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.817862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.817965 (+ 103us) server_negotiation.cc:407] Connection header received
0929 22:45:25.818047 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.818047 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.818059 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.818108 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:25.818229 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.818711 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.819535 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.819754 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.819826 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.819991 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.820044 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.820106 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.820178 (+ 72us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.820196 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:45:25.822330 14571 raft_consensus.cc:1261] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Refusing update from remote peer 19db16e3cdec4c4da16de766caf28392: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:25.822350 14290 raft_consensus.cc:1261] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Refusing update from remote peer 19db16e3cdec4c4da16de766caf28392: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:25.822623 14735 consensus_queue.cc:1035] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:25.822762 14730 consensus_queue.cc:1035] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:25.829460 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.827079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:40179 (local address 127.12.27.130:39897)
0929 22:45:25.827115 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.827116 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.827201 (+ 85us) server_negotiation.cc:407] Connection header received
0929 22:45:25.827300 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.827300 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.827311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.827364 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:25.827482 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.828000 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.828734 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.829031 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.829097 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.829225 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.829255 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.829299 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.829386 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.829404 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:45:25.829468 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.827017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:39897 (local address 127.12.27.129:40179)
0929 22:45:25.827140 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.827149 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.827227 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.827370 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.827371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.827373 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:25.827415 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.827416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.828082 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.828084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.828637 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.828639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.829096 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.829097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.829152 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.829156 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.829318 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.829320 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.829368 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.829415 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":74,"threads_started":1}
I20260929 22:45:25.836166 14132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:25.836273 14132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:25.836906 14132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Sending DeleteTablet for 3 replicas of tablet f7f3f22e6b0f4149852e86efcfeeb2cb
I20260929 22:45:25.837172 14552 tablet_service.cc:1514] Processing DeleteTablet for tablet f7f3f22e6b0f4149852e86efcfeeb2cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:25 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:53054
I20260929 22:45:25.837288 14713 tablet_replica.cc:330] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: stopping tablet replica
I20260929 22:45:25.837339 14713 raft_consensus.cc:2229] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:25.837384 14713 raft_consensus.cc:2258] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:25.837566 14410 tablet_service.cc:1514] Processing DeleteTablet for tablet f7f3f22e6b0f4149852e86efcfeeb2cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:25 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:43094
I20260929 22:45:25.837668 14270 tablet_service.cc:1514] Processing DeleteTablet for tablet f7f3f22e6b0f4149852e86efcfeeb2cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:25 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:51874
I20260929 22:45:25.837683 14712 tablet_replica.cc:330] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: stopping tablet replica
I20260929 22:45:25.837743 14712 raft_consensus.cc:2229] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:25.837750 14714 tablet_replica.cc:330] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: stopping tablet replica
I20260929 22:45:25.837800 14714 raft_consensus.cc:2229] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:25.837839 14714 raft_consensus.cc:2258] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:25.837836 14712 raft_consensus.cc:2258] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:25.838109 14712 ts_tablet_manager.cc:1905] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:25.838207 14714 ts_tablet_manager.cc:1905] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:25.838307 14132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:25.838433 14132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:25.839694 14270 tablet_service.cc:1467] Processing CreateTablet for tablet 43d0032f0cc14ad2b4f1f9c88585197f (DEFAULT_TABLE table=test-table [id=cf46a2f035c243ef98279588fd0c9bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:25.839794 14270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d0032f0cc14ad2b4f1f9c88585197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:25.839815 14712 ts_tablet_manager.cc:1918] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:25.839865 14712 log.cc:1196] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/f7f3f22e6b0f4149852e86efcfeeb2cb
I20260929 22:45:25.840075 14712 ts_tablet_manager.cc:1939] T f7f3f22e6b0f4149852e86efcfeeb2cb P 19db16e3cdec4c4da16de766caf28392: Deleting consensus metadata
I20260929 22:45:25.840200 14714 ts_tablet_manager.cc:1918] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:25.840247 14714 log.cc:1196] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/f7f3f22e6b0f4149852e86efcfeeb2cb
I20260929 22:45:25.840380 14117 catalog_manager.cc:4841] TS 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897): tablet f7f3f22e6b0f4149852e86efcfeeb2cb (table test-table [id=7347688b587c41b7a7ca5e443bc2b934]) successfully deleted
I20260929 22:45:25.840456 14714 ts_tablet_manager.cc:1939] T f7f3f22e6b0f4149852e86efcfeeb2cb P 3e742dba3b9e428dbbdd13dbb2643713: Deleting consensus metadata
I20260929 22:45:25.840762 14117 catalog_manager.cc:4841] TS 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269): tablet f7f3f22e6b0f4149852e86efcfeeb2cb (table test-table [id=7347688b587c41b7a7ca5e443bc2b934]) successfully deleted
I20260929 22:45:25.841032 14725 tablet_bootstrap.cc:492] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713: Bootstrap starting.
I20260929 22:45:25.841070 14410 tablet_service.cc:1467] Processing CreateTablet for tablet 43d0032f0cc14ad2b4f1f9c88585197f (DEFAULT_TABLE table=test-table [id=cf46a2f035c243ef98279588fd0c9bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:25.841178 14410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d0032f0cc14ad2b4f1f9c88585197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:25.841337 14725 tablet_bootstrap.cc:654] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:25.841895 14725 tablet_bootstrap.cc:492] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713: No bootstrap required, opened a new log
I20260929 22:45:25.841948 14725 ts_tablet_manager.cc:1397] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:25.842043 14725 raft_consensus.cc:348] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.842111 14725 raft_consensus.cc:374] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:25.842132 14725 raft_consensus.cc:729] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e742dba3b9e428dbbdd13dbb2643713, State: Initialized, Role: FOLLOWER
I20260929 22:45:25.842175 14725 consensus_queue.cc:260] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.842265 14725 ts_tablet_manager.cc:1428] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:25.842327 14723 tablet_bootstrap.cc:492] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Bootstrap starting.
I20260929 22:45:25.842690 14723 tablet_bootstrap.cc:654] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:25.843245 14552 tablet_service.cc:1467] Processing CreateTablet for tablet 43d0032f0cc14ad2b4f1f9c88585197f (DEFAULT_TABLE table=test-table [id=cf46a2f035c243ef98279588fd0c9bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:25.843307 14723 tablet_bootstrap.cc:492] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: No bootstrap required, opened a new log
I20260929 22:45:25.843351 14723 ts_tablet_manager.cc:1397] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:25.843356 14552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d0032f0cc14ad2b4f1f9c88585197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:25.843498 14723 raft_consensus.cc:348] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.843564 14723 raft_consensus.cc:374] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:25.843586 14723 raft_consensus.cc:729] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19db16e3cdec4c4da16de766caf28392, State: Initialized, Role: FOLLOWER
I20260929 22:45:25.843654 14723 consensus_queue.cc:260] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.843760 14723 ts_tablet_manager.cc:1428] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:25.844280 14713 ts_tablet_manager.cc:1905] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:25.844815 14724 tablet_bootstrap.cc:492] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Bootstrap starting.
I20260929 22:45:25.845130 14724 tablet_bootstrap.cc:654] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:25.845535 14713 ts_tablet_manager.cc:1918] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:45:25.845598 14713 log.cc:1196] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/f7f3f22e6b0f4149852e86efcfeeb2cb
I20260929 22:45:25.845744 14724 tablet_bootstrap.cc:492] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: No bootstrap required, opened a new log
I20260929 22:45:25.845798 14724 ts_tablet_manager.cc:1397] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:25.845834 14713 ts_tablet_manager.cc:1939] T f7f3f22e6b0f4149852e86efcfeeb2cb P 723e0e2bea7444c88e789921e2b7415d: Deleting consensus metadata
I20260929 22:45:25.845927 14724 raft_consensus.cc:348] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.845994 14724 raft_consensus.cc:374] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:25.846020 14724 raft_consensus.cc:729] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 723e0e2bea7444c88e789921e2b7415d, State: Initialized, Role: FOLLOWER
I20260929 22:45:25.846069 14724 consensus_queue.cc:260] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.846153 14724 ts_tablet_manager.cc:1428] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:25.846635 14116 catalog_manager.cc:4841] TS 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577): tablet f7f3f22e6b0f4149852e86efcfeeb2cb (table test-table [id=7347688b587c41b7a7ca5e443bc2b934]) successfully deleted
I20260929 22:45:25.851356 14729 raft_consensus.cc:482] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:25.851414 14729 raft_consensus.cc:504] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.851754 14729 leader_election.cc:288] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269), 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897)
I20260929 22:45:25.854863 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.851976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:45935 (local address 127.12.27.129:43269)
0929 22:45:25.852035 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.852037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.852237 (+ 200us) server_negotiation.cc:407] Connection header received
0929 22:45:25.852305 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.852306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.852317 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.852365 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:25.852512 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.853050 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.854154 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.854514 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.854607 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.854616 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.854767 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.854798 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:45:25.854882 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.851883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.12.27.131:45935)
0929 22:45:25.852161 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.852170 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.852251 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.852376 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.852377 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.852379 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:25.852444 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.852446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.853133 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.853134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.854069 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.854072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.854606 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.854607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.854682 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.854686 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.854759 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.854799 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":49,"threads_started":1}
I20260929 22:45:25.855060 14290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d0032f0cc14ad2b4f1f9c88585197f" candidate_uuid: "723e0e2bea7444c88e789921e2b7415d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e742dba3b9e428dbbdd13dbb2643713" is_pre_election: true
I20260929 22:45:25.855134 14290 raft_consensus.cc:2454] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 723e0e2bea7444c88e789921e2b7415d in term 0.
I20260929 22:45:25.855283 14504 leader_election.cc:302] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e742dba3b9e428dbbdd13dbb2643713, 723e0e2bea7444c88e789921e2b7415d; no voters:
I20260929 22:45:25.855399 14729 raft_consensus.cc:2781] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:25.855446 14729 raft_consensus.cc:482] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:25.855461 14729 raft_consensus.cc:3037] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:25.855926 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.852091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:36639 (local address 127.12.27.130:39897)
0929 22:45:25.852129 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.852131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.852241 (+ 110us) server_negotiation.cc:407] Connection header received
0929 22:45:25.852343 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.852345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.852354 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.852412 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:25.852619 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.853374 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.854829 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.855380 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.855424 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.855431 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.855829 (+ 398us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.855869 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:45:25.855937 14753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.852034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:39897 (local address 127.12.27.131:36639)
0929 22:45:25.852179 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.852189 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.852264 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.852451 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.852451 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.852455 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:25.852546 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.852548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.853576 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.853577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.854730 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.854732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.855662 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.855663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.855735 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.855738 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.855813 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.855854 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":74,"threads_started":1}
I20260929 22:45:25.856406 14729 raft_consensus.cc:504] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.856447 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d0032f0cc14ad2b4f1f9c88585197f" candidate_uuid: "723e0e2bea7444c88e789921e2b7415d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392" is_pre_election: true
I20260929 22:45:25.856515 14416 raft_consensus.cc:2454] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 723e0e2bea7444c88e789921e2b7415d in term 0.
I20260929 22:45:25.856544 14729 leader_election.cc:288] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [CANDIDATE]: Term 1 election: Requested vote from peers 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269), 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897)
I20260929 22:45:25.856786 14290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d0032f0cc14ad2b4f1f9c88585197f" candidate_uuid: "723e0e2bea7444c88e789921e2b7415d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e742dba3b9e428dbbdd13dbb2643713"
I20260929 22:45:25.856858 14290 raft_consensus.cc:3037] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:25.856812 14416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d0032f0cc14ad2b4f1f9c88585197f" candidate_uuid: "723e0e2bea7444c88e789921e2b7415d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19db16e3cdec4c4da16de766caf28392"
I20260929 22:45:25.856940 14416 raft_consensus.cc:3037] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:25.857524 14416 raft_consensus.cc:2454] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 723e0e2bea7444c88e789921e2b7415d in term 1.
I20260929 22:45:25.857560 14290 raft_consensus.cc:2454] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 723e0e2bea7444c88e789921e2b7415d in term 1.
I20260929 22:45:25.857689 14504 leader_election.cc:302] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e742dba3b9e428dbbdd13dbb2643713, 723e0e2bea7444c88e789921e2b7415d; no voters:
I20260929 22:45:25.857797 14729 raft_consensus.cc:2781] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:25.857937 14729 raft_consensus.cc:686] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 1 LEADER]: Becoming Leader. State: Replica: 723e0e2bea7444c88e789921e2b7415d, State: Running, Role: LEADER
I20260929 22:45:25.858001 14729 consensus_queue.cc:237] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } }
I20260929 22:45:25.858592 14131 catalog_manager.cc:5495] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d reported cstate change: term changed from 0 to 1, leader changed from <none> to 723e0e2bea7444c88e789921e2b7415d (127.12.27.131). New cstate: current_term: 1 leader_uuid: "723e0e2bea7444c88e789921e2b7415d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "723e0e2bea7444c88e789921e2b7415d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36577 } health_report { overall_health: HEALTHY } } }
I20260929 22:45:25.866508 14734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.863964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.12.27.131:36577)
0929 22:45:25.864004 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.864007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.864042 (+ 35us) server_negotiation.cc:407] Connection header received
0929 22:45:25.864121 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.864122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.864139 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.864190 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:25.864296 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.864788 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.865824 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.866010 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.866061 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.866216 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.866305 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.866357 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.866423 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.866437 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:45:25.871061 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.868863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:36115 (local address 127.12.27.129:43269)
0929 22:45:25.868944 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.868946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.868954 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:25.868978 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.868979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.868988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.869044 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:25.869182 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.869622 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.870361 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.870555 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.870636 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.870802 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.870838 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.870910 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.870971 (+ 61us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.870990 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260929 22:45:25.871109 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.868730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.12.27.131:36115)
0929 22:45:25.868869 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.868879 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.868929 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.869046 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.869046 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.869047 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:25.869100 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.869101 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.869696 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.869697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.870276 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.870278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.870638 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.870639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.870710 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.870721 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.870913 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.870915 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.870967 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.871005 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260929 22:45:25.873288 14416 raft_consensus.cc:1261] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Refusing update from remote peer 723e0e2bea7444c88e789921e2b7415d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:25.873310 14290 raft_consensus.cc:1261] T 43d0032f0cc14ad2b4f1f9c88585197f P 3e742dba3b9e428dbbdd13dbb2643713 [term 1 FOLLOWER]: Refusing update from remote peer 723e0e2bea7444c88e789921e2b7415d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:25.873543 14754 consensus_queue.cc:1035] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e742dba3b9e428dbbdd13dbb2643713" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 43269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:25.873644 14729 consensus_queue.cc:1035] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [LEADER]: Connected to new peer: Peer: permanent_uuid: "19db16e3cdec4c4da16de766caf28392" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:25.880452 14734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.877847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:39307 (local address 127.12.27.131:36577)
0929 22:45:25.877886 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:25.877888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:25.877899 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:45:25.877921 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:25.877921 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:25.877932 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:25.877982 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:25.878104 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.878808 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.879776 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.880010 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.880092 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.880236 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.880267 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.880312 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:25.880367 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 22:45:25.880391 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:45:25.880470 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:25.877795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36577 (local address 127.12.27.129:39307)
0929 22:45:25.877838 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:25.877848 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:25.877881 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:25.877985 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:25.877986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:25.877987 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:45:25.878023 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.878025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.878953 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.878954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.879714 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:25.879717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:25.880090 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:25.880091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:25.880145 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:25.880150 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:45:25.880311 (+ 161us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:45:25.880313 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:45:25.880363 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:45:25.880405 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 22:45:25.880941 14696 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 22:45:27.404134 14131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:27.404230 14131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:27.405196 14131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a78174a926841e69eda816531ed90eb: Sending DeleteTablet for 3 replicas of tablet 43d0032f0cc14ad2b4f1f9c88585197f
I20260929 22:45:27.405457 14270 tablet_service.cc:1514] Processing DeleteTablet for tablet 43d0032f0cc14ad2b4f1f9c88585197f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:27 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:51874
I20260929 22:45:27.405551 14410 tablet_service.cc:1514] Processing DeleteTablet for tablet 43d0032f0cc14ad2b4f1f9c88585197f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:27 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:43094
I20260929 22:45:27.405651 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 14204
I20260929 22:45:27.405673 14552 tablet_service.cc:1514] Processing DeleteTablet for tablet 43d0032f0cc14ad2b4f1f9c88585197f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:27 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:53054
I20260929 22:45:27.407330 14786 tablet_replica.cc:330] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: stopping tablet replica
I20260929 22:45:27.407416 14786 raft_consensus.cc:2229] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:27.407500 14786 raft_consensus.cc:2258] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:27.407594 14787 tablet_replica.cc:330] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: stopping tablet replica
I20260929 22:45:27.407696 14787 raft_consensus.cc:2229] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:27.407780 14786 ts_tablet_manager.cc:1905] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:27.407801 14787 raft_consensus.cc:2258] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:27.408051 14787 ts_tablet_manager.cc:1905] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:27.409633 14786 ts_tablet_manager.cc:1918] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:45:27.409735 14786 log.cc:1196] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/43d0032f0cc14ad2b4f1f9c88585197f
I20260929 22:45:27.409994 14787 ts_tablet_manager.cc:1918] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 22:45:27.410013 14786 ts_tablet_manager.cc:1939] T 43d0032f0cc14ad2b4f1f9c88585197f P 19db16e3cdec4c4da16de766caf28392: Deleting consensus metadata
I20260929 22:45:27.410059 14787 log.cc:1196] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/43d0032f0cc14ad2b4f1f9c88585197f
I20260929 22:45:27.410297 14787 ts_tablet_manager.cc:1939] T 43d0032f0cc14ad2b4f1f9c88585197f P 723e0e2bea7444c88e789921e2b7415d: Deleting consensus metadata
I20260929 22:45:27.410360 14117 catalog_manager.cc:4841] TS 19db16e3cdec4c4da16de766caf28392 (127.12.27.130:39897): tablet 43d0032f0cc14ad2b4f1f9c88585197f (table test-table [id=cf46a2f035c243ef98279588fd0c9bb9]) successfully deleted
I20260929 22:45:27.410778 14116 catalog_manager.cc:4841] TS 723e0e2bea7444c88e789921e2b7415d (127.12.27.131:36577): tablet 43d0032f0cc14ad2b4f1f9c88585197f (table test-table [id=cf46a2f035c243ef98279588fd0c9bb9]) successfully deleted
W20260929 22:45:27.413353 14117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:43269 (error 108)
I20260929 22:45:27.413595 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 14345
I20260929 22:45:27.414425 14789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:27.413714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:43269 (local address 127.0.0.1:36616)
0929 22:45:27.414347 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:27.414394 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:43269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":57,"threads_started":1}
W20260929 22:45:27.414539 14117 catalog_manager.cc:4584] TS 3e742dba3b9e428dbbdd13dbb2643713 (127.12.27.129:43269): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43d0032f0cc14ad2b4f1f9c88585197f: Network error: Client connection negotiation failed: client connection to 127.12.27.129:43269: connect: Connection refused (error 111)
I20260929 22:45:27.419598 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 14487
I20260929 22:45:27.424779 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 14100
2026-09-29T22:45:27Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5716 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:27 dist-test-slave-00d6 krb5kdc[14792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:27 dist-test-slave-00d6 krb5kdc[14792](info): set up 2 sockets
Sep 29 22:45:27 dist-test-slave-00d6 krb5kdc[14792](info): commencing operation
krb5kdc: starting...
W20260929 22:45:28.471844 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:28 dist-test-slave-00d6 krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:28.592067 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39387
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:39387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:28.671924 14805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:28.672111 14805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:28.672132 14805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:28.673286 14805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:28.673329 14805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:28.673343 14805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:28.673357 14805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:28.673368 14805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:28.674817 14805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:39387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:28.675040 14805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:28.675266 14805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:28.680368 14813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:28.680369 14811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:28.680397 14805 server_base.cc:1034] running on GCE node
W20260929 22:45:28.680405 14810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:28.680843 14805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:28.681221 14805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:28.682395 14805 hybrid_clock.cc:648] HybridClock initialized: now 1790721928682358 us; error 58 us; skew 500 ppm
Sep 29 22:45:28 dist-test-slave-00d6 krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721928, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:28.690768 14805 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:28.691242 14805 webserver.cc:460] Webserver started at http://127.12.27.190:44957/ using document root <none> and password file <none>
I20260929 22:45:28.691488 14805 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:28.691557 14805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:28.691721 14805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:28.692752 14805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "b46ed4f67d3541f5b21673b60238bc41"
format_stamp: "Formatted at 2026-09-29 22:45:28 on dist-test-slave-00d6"
server_key: "21fde6bc09f1fe67ee18e52b790a0317"
server_key_iv: "d9a2c6f0e79e57d953cad4b08f15f97c"
server_key_version: "encryptionkey@0"
I20260929 22:45:28.693130 14805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "b46ed4f67d3541f5b21673b60238bc41"
format_stamp: "Formatted at 2026-09-29 22:45:28 on dist-test-slave-00d6"
server_key: "21fde6bc09f1fe67ee18e52b790a0317"
server_key_iv: "d9a2c6f0e79e57d953cad4b08f15f97c"
server_key_version: "encryptionkey@0"
I20260929 22:45:28.694458 14805 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:28.695246 14820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:28.695425 14805 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:28.695524 14805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "b46ed4f67d3541f5b21673b60238bc41"
format_stamp: "Formatted at 2026-09-29 22:45:28 on dist-test-slave-00d6"
server_key: "21fde6bc09f1fe67ee18e52b790a0317"
server_key_iv: "d9a2c6f0e79e57d953cad4b08f15f97c"
server_key_version: "encryptionkey@0"
I20260929 22:45:28.695605 14805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:28.721731 14805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:28.723693 14805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:28.723866 14805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:28.727759 14805 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:39387
I20260929 22:45:28.727802 14872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:39387 every 8 connection(s)
I20260929 22:45:28.728147 14805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:28.728924 14873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:28.731112 14873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41: Bootstrap starting.
I20260929 22:45:28.731760 14873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:28.732059 14873 log.cc:824] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:28.732748 14873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41: No bootstrap required, opened a new log
I20260929 22:45:28.734278 14873 raft_consensus.cc:348] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46ed4f67d3541f5b21673b60238bc41" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39387 } }
I20260929 22:45:28.734438 14873 raft_consensus.cc:374] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:28.734512 14873 raft_consensus.cc:729] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46ed4f67d3541f5b21673b60238bc41, State: Initialized, Role: FOLLOWER
I20260929 22:45:28.734683 14873 consensus_queue.cc:260] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46ed4f67d3541f5b21673b60238bc41" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39387 } }
I20260929 22:45:28.734766 14873 raft_consensus.cc:388] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:28.734803 14873 raft_consensus.cc:482] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:28.734855 14873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:28.735337 14873 raft_consensus.cc:504] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46ed4f67d3541f5b21673b60238bc41" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39387 } }
I20260929 22:45:28.735450 14873 leader_election.cc:302] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b46ed4f67d3541f5b21673b60238bc41; no voters:
I20260929 22:45:28.735648 14873 leader_election.cc:288] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:28.735706 14876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:28.735860 14876 raft_consensus.cc:686] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [term 1 LEADER]: Becoming Leader. State: Replica: b46ed4f67d3541f5b21673b60238bc41, State: Running, Role: LEADER
I20260929 22:45:28.735912 14873 sys_catalog.cc:564] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:28.736022 14876 consensus_queue.cc:237] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46ed4f67d3541f5b21673b60238bc41" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39387 } }
I20260929 22:45:28.736630 14878 sys_catalog.cc:455] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b46ed4f67d3541f5b21673b60238bc41. Latest consensus state: current_term: 1 leader_uuid: "b46ed4f67d3541f5b21673b60238bc41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46ed4f67d3541f5b21673b60238bc41" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39387 } } }
I20260929 22:45:28.736732 14878 sys_catalog.cc:458] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:28.736868 14877 sys_catalog.cc:455] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b46ed4f67d3541f5b21673b60238bc41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46ed4f67d3541f5b21673b60238bc41" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39387 } } }
I20260929 22:45:28.737103 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 14805
I20260929 22:45:28.736931 14885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:28.737180 14877 sys_catalog.cc:458] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:28.737192 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:28.737356 12398 external_mini_cluster.cc:1428] Setting key 0bd7cc9623dbd44dc432cf015320293d
I20260929 22:45:28.737741 14885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:28.739323 14885 catalog_manager.cc:1347] Generated new cluster ID: aa8bbc0314ee4aa1aeb8fcd3207f5109
I20260929 22:45:28.739374 14885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:45:28 dist-test-slave-00d6 krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:28.750172 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:28.737991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44380 (local address 127.12.27.190:39387)
0929 22:45:28.738164 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:28.738174 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:28.738226 (+ 52us) server_negotiation.cc:407] Connection header received
0929 22:45:28.738351 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:28.738358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:28.738419 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:28.738556 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:28.739427 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:28.740994 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:28.742049 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:28.742755 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:28.742877 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:28.746020 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:28.746025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:28.746025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:28.746038 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:28.748440 (+ 2402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:28.748829 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:28.748833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:28.748833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:28.748966 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:28.749172 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:28.749173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:28.749174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:28.749528 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:28.749713 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:28.749787 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:45:28.749939 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
I20260929 22:45:28.769021 14885 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:28.769871 14885 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:28.775741 14885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b46ed4f67d3541f5b21673b60238bc41: Generated new TSK 0
I20260929 22:45:28.775929 14885 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:28.804751 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39387
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:28.886721 14899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:28.886930 14899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:28.886955 14899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:28.888171 14899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:28.888207 14899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:28.888244 14899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:28.889802 14899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:28.889992 14899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:28.890162 14899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:28.895063 14905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:28.895099 14907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:28.895185 14899 server_base.cc:1034] running on GCE node
W20260929 22:45:28.895260 14904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:28.895499 14899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:28.895782 14899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:28.896934 14899 hybrid_clock.cc:648] HybridClock initialized: now 1790721928896926 us; error 51 us; skew 500 ppm
Sep 29 22:45:28 dist-test-slave-00d6 krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721928, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:28.899521 14899 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:28.899955 14899 webserver.cc:460] Webserver started at http://127.12.27.129:40925/ using document root <none> and password file <none>
I20260929 22:45:28.900178 14899 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:28.900242 14899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:28.900382 14899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:28.901372 14899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "61f060a3ed694da7bbae801ceea67dbe"
format_stamp: "Formatted at 2026-09-29 22:45:28 on dist-test-slave-00d6"
server_key: "e36794887f6afbb9254624d4d4b38174"
server_key_iv: "b3a432b55bd54a8818211b8fbee852c7"
server_key_version: "encryptionkey@0"
I20260929 22:45:28.901711 14899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "61f060a3ed694da7bbae801ceea67dbe"
format_stamp: "Formatted at 2026-09-29 22:45:28 on dist-test-slave-00d6"
server_key: "e36794887f6afbb9254624d4d4b38174"
server_key_iv: "b3a432b55bd54a8818211b8fbee852c7"
server_key_version: "encryptionkey@0"
I20260929 22:45:28.902971 14899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:28.903744 14914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:28.903915 14899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:45:28.904006 14899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "61f060a3ed694da7bbae801ceea67dbe"
format_stamp: "Formatted at 2026-09-29 22:45:28 on dist-test-slave-00d6"
server_key: "e36794887f6afbb9254624d4d4b38174"
server_key_iv: "b3a432b55bd54a8818211b8fbee852c7"
server_key_version: "encryptionkey@0"
I20260929 22:45:28.904085 14899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:28.913537 14899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:28.915719 14899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:28.915865 14899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:28.916074 14899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:28.916355 14899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:28.916405 14899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:28.916445 14899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:28.916474 14899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:28.922200 14899 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:41829
I20260929 22:45:28.922250 15028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:41829 every 8 connection(s)
I20260929 22:45:28.922541 14899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:45:28 dist-test-slave-00d6 krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721928, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:28.929226 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 14899
I20260929 22:45:28.929353 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:28.929550 12398 external_mini_cluster.cc:1428] Setting key c94dbea25540d1930f6c0efefe99ab5e
I20260929 22:45:28.932049 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:28.923204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:47173 (local address 127.12.27.190:39387)
0929 22:45:28.923264 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:28.923266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:28.923445 (+ 179us) server_negotiation.cc:407] Connection header received
0929 22:45:28.924021 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:28.924022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:28.924035 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:28.924078 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:28.924985 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:28.925481 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:28.926452 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:28.926663 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:28.926760 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:28.928843 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:28.928845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:28.928846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:28.928852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:28.930481 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:28.930963 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:28.930964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:28.930964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:28.931015 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:28.931285 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:28.931286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:28.931286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:28.931384 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:28.931434 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:28.931828 (+ 394us) server_negotiation.cc:299] Negotiation successful
0929 22:45:28.931921 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:45:28.932137 15031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:28.923183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39387 (local address 127.12.27.129:47173)
0929 22:45:28.923329 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:28.923368 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:28.923909 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:28.924155 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:28.924159 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:28.924703 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:28.924884 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:28.924888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:28.925573 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:28.925574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:28.926360 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:28.926362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:28.926769 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:28.926770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:28.926901 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:28.927397 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:28.927405 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:28.928758 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:28.930568 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:28.930575 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:28.930577 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:28.930892 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:28.931079 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:28.931080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:28.931081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:28.931225 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:28.931445 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:28.931451 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:28.931655 (+ 204us) client_negotiation.cc:769] Sending connection context
0929 22:45:28.931787 (+ 132us) client_negotiation.cc:240] Negotiation successful
0929 22:45:28.931954 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260929 22:45:28.932611 15029 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39387
I20260929 22:45:28.932734 15029 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:28.932934 15029 heartbeater.cc:511] Master 127.12.27.190:39387 requested a full tablet report, sending...
I20260929 22:45:28.933427 14837 ts_manager.cc:194] Registered new tserver with Master: 61f060a3ed694da7bbae801ceea67dbe (127.12.27.129:41829)
I20260929 22:45:28.934036 14837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:47173
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:28.954674 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39387
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:29.034348 15034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:29.034545 15034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:29.034569 15034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:29.035722 15034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:29.035760 15034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:29.035786 15034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:29.037341 15034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:29.037569 15034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:29.037820 15034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:29.042654 15040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:29.042860 15034 server_base.cc:1034] running on GCE node
W20260929 22:45:29.042738 15042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:29.042665 15039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:29.043119 15034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:29.043313 15034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:29.044489 15034 hybrid_clock.cc:648] HybridClock initialized: now 1790721929044470 us; error 32 us; skew 500 ppm
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:29.047127 15034 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:29.047555 15034 webserver.cc:460] Webserver started at http://127.12.27.130:43781/ using document root <none> and password file <none>
I20260929 22:45:29.047801 15034 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:29.047871 15034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:29.048026 15034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:29.049039 15034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "f6243d8b16a243288fabc9ed36771371"
format_stamp: "Formatted at 2026-09-29 22:45:29 on dist-test-slave-00d6"
server_key: "7bc1f995c24a2df22b23cf1c874944b2"
server_key_iv: "4b6bb3d0e27a959815c44ad9bf579fb5"
server_key_version: "encryptionkey@0"
I20260929 22:45:29.049399 15034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "f6243d8b16a243288fabc9ed36771371"
format_stamp: "Formatted at 2026-09-29 22:45:29 on dist-test-slave-00d6"
server_key: "7bc1f995c24a2df22b23cf1c874944b2"
server_key_iv: "4b6bb3d0e27a959815c44ad9bf579fb5"
server_key_version: "encryptionkey@0"
I20260929 22:45:29.050721 15034 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:29.051530 15049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.051819 15034 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:29.051927 15034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "f6243d8b16a243288fabc9ed36771371"
format_stamp: "Formatted at 2026-09-29 22:45:29 on dist-test-slave-00d6"
server_key: "7bc1f995c24a2df22b23cf1c874944b2"
server_key_iv: "4b6bb3d0e27a959815c44ad9bf579fb5"
server_key_version: "encryptionkey@0"
I20260929 22:45:29.052000 15034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:29.062603 15034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:29.064841 15034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:29.064999 15034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:29.065220 15034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:29.065521 15034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:29.065572 15034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.065613 15034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:29.065641 15034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.070938 15034 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:40253
I20260929 22:45:29.071018 15162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:40253 every 8 connection(s)
I20260929 22:45:29.071322 15034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:29.079173 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15034
I20260929 22:45:29.079272 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:29.079509 12398 external_mini_cluster.cc:1428] Setting key 51ebd3bfe86007d80109e536ad636e98
I20260929 22:45:29.079816 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:29.072102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:44979 (local address 127.12.27.190:39387)
0929 22:45:29.072154 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:29.072156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:29.072299 (+ 143us) server_negotiation.cc:407] Connection header received
0929 22:45:29.072752 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:29.072753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:29.072761 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:29.072822 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:29.073662 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.074150 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.075071 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.075246 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.075297 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:29.077284 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:29.077286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:29.077286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:29.077292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:29.078485 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:29.078822 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:29.078822 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:29.078823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:29.078873 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:29.079101 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:29.079102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:29.079103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:29.079246 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:29.079317 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:29.079610 (+ 293us) server_negotiation.cc:299] Negotiation successful
0929 22:45:29.079724 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:45:29.080006 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:29.072037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39387 (local address 127.12.27.130:44979)
0929 22:45:29.072186 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:29.072225 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:29.072668 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:29.072885 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:29.072888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:29.073406 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:29.073589 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:29.073593 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.074224 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.074224 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:29.074993 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:29.074995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.075314 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.075315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:29.075405 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:29.075946 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:29.075954 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:29.077194 (+ 1240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:29.078553 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:29.078559 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:29.078560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:29.078756 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:29.078931 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:29.078931 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:29.078931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:29.079030 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:29.079332 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:29.079337 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:29.079469 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 22:45:29.079584 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:45:29.079770 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260929 22:45:29.080521 15163 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39387
I20260929 22:45:29.080605 15163 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:29.080780 15163 heartbeater.cc:511] Master 127.12.27.190:39387 requested a full tablet report, sending...
I20260929 22:45:29.081121 14837 ts_manager.cc:194] Registered new tserver with Master: f6243d8b16a243288fabc9ed36771371 (127.12.27.130:40253)
I20260929 22:45:29.081481 14837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:44979
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:29.104545 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39387
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:29.183525 15169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:29.183733 15169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:29.183756 15169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:29.184919 15169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:29.184959 15169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:29.184985 15169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:29.186396 15169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:29.186640 15169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:29.186863 15169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:29.191717 15174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:29.191709 15177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:29.191725 15169 server_base.cc:1034] running on GCE node
W20260929 22:45:29.191709 15175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:29.192222 15169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:29.192454 15169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:29.193629 15169 hybrid_clock.cc:648] HybridClock initialized: now 1790721929193619 us; error 26 us; skew 500 ppm
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:29.196070 15169 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:29.196524 15169 webserver.cc:460] Webserver started at http://127.12.27.131:44741/ using document root <none> and password file <none>
I20260929 22:45:29.196759 15169 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:29.196825 15169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:29.196962 15169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:29.198057 15169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "175ef7791a374a149f9fd78f6e7140a2"
format_stamp: "Formatted at 2026-09-29 22:45:29 on dist-test-slave-00d6"
server_key: "230dd0e11b8c2202f034f7dc7b5f8971"
server_key_iv: "e49393fdf943e7295676579894cc396d"
server_key_version: "encryptionkey@0"
I20260929 22:45:29.198403 15169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "175ef7791a374a149f9fd78f6e7140a2"
format_stamp: "Formatted at 2026-09-29 22:45:29 on dist-test-slave-00d6"
server_key: "230dd0e11b8c2202f034f7dc7b5f8971"
server_key_iv: "e49393fdf943e7295676579894cc396d"
server_key_version: "encryptionkey@0"
I20260929 22:45:29.199790 15169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:45:29.200448 15184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.200619 15169 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.200723 15169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "175ef7791a374a149f9fd78f6e7140a2"
format_stamp: "Formatted at 2026-09-29 22:45:29 on dist-test-slave-00d6"
server_key: "230dd0e11b8c2202f034f7dc7b5f8971"
server_key_iv: "e49393fdf943e7295676579894cc396d"
server_key_version: "encryptionkey@0"
I20260929 22:45:29.200803 15169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:29.208853 15169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:29.211007 15169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:29.211161 15169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:29.211365 15169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:29.211704 15169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:29.211764 15169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.211803 15169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:29.211829 15169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:29.217408 15169 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:36587
I20260929 22:45:29.217448 15297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:36587 every 8 connection(s)
I20260929 22:45:29.217733 15169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:29.218835 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15169
I20260929 22:45:29.218943 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:29.219146 12398 external_mini_cluster.cc:1428] Setting key 0927facb31a60828da1eddf65175a35b
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:29.226770 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:29.218354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:37593 (local address 127.12.27.190:39387)
0929 22:45:29.218417 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:29.218419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:29.218623 (+ 204us) server_negotiation.cc:407] Connection header received
0929 22:45:29.219196 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:29.219197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:29.219209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:29.219272 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:29.220396 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.220888 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.221853 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.222070 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.222155 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:29.224206 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:29.224208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:29.224208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:29.224215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:29.225433 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:29.225839 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:29.225841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:29.225841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:29.225897 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:29.226150 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:29.226151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:29.226151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:29.226265 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:29.226342 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:29.226612 (+ 270us) server_negotiation.cc:299] Negotiation successful
0929 22:45:29.226683 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:45:29.226939 15300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:29.218353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39387 (local address 127.12.27.131:37593)
0929 22:45:29.218506 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:29.218544 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:29.219098 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:29.219346 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:29.219349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:29.220126 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:29.220305 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:29.220310 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.220985 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.220986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:29.221762 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:29.221764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:29.222163 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:29.222164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:29.222290 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:29.222775 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:29.222782 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:29.224116 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:29.225543 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:29.225550 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:29.225552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:29.225762 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:29.225981 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:29.225981 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:29.225982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:29.226082 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:29.226331 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:29.226337 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:29.226469 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 22:45:29.226592 (+ 123us) client_negotiation.cc:240] Negotiation successful
0929 22:45:29.226734 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260929 22:45:29.227362 15298 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39387
I20260929 22:45:29.227432 15298 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:29.227557 15298 heartbeater.cc:511] Master 127.12.27.190:39387 requested a full tablet report, sending...
I20260929 22:45:29.227911 14837 ts_manager.cc:194] Registered new tserver with Master: 175ef7791a374a149f9fd78f6e7140a2 (127.12.27.131:36587)
I20260929 22:45:29.228284 14837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:37593
I20260929 22:45:29.230863 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 22:45:29.241861 14895 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:29.241036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44390 (local address 127.12.27.190:39387)
0929 22:45:29.241101 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:29.241103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:29.241239 (+ 136us) server_negotiation.cc:407] Connection header received
0929 22:45:29.241280 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:29.241281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:29.241289 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:29.241337 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:29.241802 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44390: BlockingRecv error: recv got EOF from 127.0.0.1:44390 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:45:29.242705 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 14899
I20260929 22:45:29.246906 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15034
I20260929 22:45:29.250780 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15169
I20260929 22:45:29.254817 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 14805
2026-09-29T22:45:29Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1828 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[15310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[15310](info): set up 2 sockets
Sep 29 22:45:29 dist-test-slave-00d6 krb5kdc[15310](info): commencing operation
krb5kdc: starting...
W20260929 22:45:30.312088 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:30 dist-test-slave-00d6 krb5kdc[15310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:30.434099 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:42663
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:42663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:30.513499 15323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:30.513744 15323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:30.513779 15323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:30.514915 15323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:30.514987 15323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:30.515012 15323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:30.515033 15323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:30.515064 15323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:30.516611 15323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:42663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:42663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:30.516908 15323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:30.517127 15323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:30.521986 15328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:30.521966 15329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:30.521966 15331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:30.522535 15323 server_base.cc:1034] running on GCE node
I20260929 22:45:30.522817 15323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:30.523104 15323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:30.524268 15323 hybrid_clock.cc:648] HybridClock initialized: now 1790721930524257 us; error 29 us; skew 500 ppm
Sep 29 22:45:30 dist-test-slave-00d6 krb5kdc[15310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721930, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:30.526608 15323 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:30.527031 15323 webserver.cc:460] Webserver started at http://127.12.27.190:40895/ using document root <none> and password file <none>
I20260929 22:45:30.527261 15323 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:30.527328 15323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:30.527472 15323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:30.528591 15323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "101c041f57e34b12840d50ef4b9c434a"
format_stamp: "Formatted at 2026-09-29 22:45:30 on dist-test-slave-00d6"
server_key: "e65764733725335374acce3528dc7a3f"
server_key_iv: "240af47b6acd6a3fc39b00748485d50b"
server_key_version: "encryptionkey@0"
I20260929 22:45:30.528945 15323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "101c041f57e34b12840d50ef4b9c434a"
format_stamp: "Formatted at 2026-09-29 22:45:30 on dist-test-slave-00d6"
server_key: "e65764733725335374acce3528dc7a3f"
server_key_iv: "240af47b6acd6a3fc39b00748485d50b"
server_key_version: "encryptionkey@0"
I20260929 22:45:30.530216 15323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:30.530916 15338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:30.531136 15323 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:30.531239 15323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "101c041f57e34b12840d50ef4b9c434a"
format_stamp: "Formatted at 2026-09-29 22:45:30 on dist-test-slave-00d6"
server_key: "e65764733725335374acce3528dc7a3f"
server_key_iv: "240af47b6acd6a3fc39b00748485d50b"
server_key_version: "encryptionkey@0"
I20260929 22:45:30.531358 15323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:30.548014 15323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:30.550283 15323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:30.550446 15323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:30.554304 15323 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:42663
I20260929 22:45:30.554359 15390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:42663 every 8 connection(s)
I20260929 22:45:30.554857 15323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:30.555526 15391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:30.557780 15391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a: Bootstrap starting.
I20260929 22:45:30.558377 15391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:30.558580 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15323
I20260929 22:45:30.558677 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:30.558715 15391 log.cc:824] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:30.558903 12398 external_mini_cluster.cc:1428] Setting key cc7d4e591d0f19795e86e41f02f65015
I20260929 22:45:30.559547 15391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a: No bootstrap required, opened a new log
I20260929 22:45:30.561685 15391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c041f57e34b12840d50ef4b9c434a" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42663 } }
I20260929 22:45:30.561842 15391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:30.561905 15391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101c041f57e34b12840d50ef4b9c434a, State: Initialized, Role: FOLLOWER
I20260929 22:45:30.562047 15391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c041f57e34b12840d50ef4b9c434a" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42663 } }
I20260929 22:45:30.562134 15391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:30.562176 15391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:30.562224 15391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:30.562742 15391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c041f57e34b12840d50ef4b9c434a" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42663 } }
I20260929 22:45:30.562856 15391 leader_election.cc:302] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 101c041f57e34b12840d50ef4b9c434a; no voters:
I20260929 22:45:30.563036 15391 leader_election.cc:288] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:30.563089 15396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:30.563262 15396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [term 1 LEADER]: Becoming Leader. State: Replica: 101c041f57e34b12840d50ef4b9c434a, State: Running, Role: LEADER
I20260929 22:45:30.563308 15391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:30.563737 15396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c041f57e34b12840d50ef4b9c434a" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42663 } }
I20260929 22:45:30.564095 15397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101c041f57e34b12840d50ef4b9c434a. Latest consensus state: current_term: 1 leader_uuid: "101c041f57e34b12840d50ef4b9c434a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c041f57e34b12840d50ef4b9c434a" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42663 } } }
I20260929 22:45:30.564599 15397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:30.564524 15398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "101c041f57e34b12840d50ef4b9c434a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c041f57e34b12840d50ef4b9c434a" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42663 } } }
I20260929 22:45:30.564806 15398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:30.564960 15408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 29 22:45:30 dist-test-slave-00d6 krb5kdc[15310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:30.565425 15408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:30.567837 15408 catalog_manager.cc:1347] Generated new cluster ID: da34d73be71d4f47b552d88550d18dc3
I20260929 22:45:30.567898 15408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:30.569828 15395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:30.559403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41360 (local address 127.12.27.190:42663)
0929 22:45:30.559586 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:30.559596 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:30.559648 (+ 52us) server_negotiation.cc:407] Connection header received
0929 22:45:30.560085 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:30.560092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:30.560137 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:30.560284 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:30.560897 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:30.561752 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:30.562694 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:30.563312 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:30.563413 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:30.566345 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:30.566348 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:30.566348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:30.566360 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:30.568307 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:30.568677 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:30.568680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:30.568681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:30.568775 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:30.568997 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:30.568998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:30.568998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:30.569233 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:30.569407 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:30.569491 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 22:45:30.569626 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260929 22:45:30.570659 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:45:30.591490 15395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:30.585934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41364 (local address 127.12.27.190:42663)
0929 22:45:30.586785 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:30.586788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:30.586799 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:45:30.586827 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:30.586828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:30.586840 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:30.586914 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:30.587529 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:30.588428 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:30.589687 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:30.590032 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:30.590093 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:30.590973 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:30.590975 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:30.590975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:30.591182 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:30.591199 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:30.591205 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:30.591276 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:30.591347 (+ 71us) server_negotiation.cc:299] Negotiation successful
0929 22:45:30.591375 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":822}
I20260929 22:45:30.592170 15408 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:30.592878 15408 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:30.599834 15408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 101c041f57e34b12840d50ef4b9c434a: Generated new TSK 0
I20260929 22:45:30.600060 15408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:45:30.608803 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15323
2026-09-29T22:45:30Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1351 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:30 dist-test-slave-00d6 krb5kdc[15424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:30 dist-test-slave-00d6 krb5kdc[15424](info): set up 2 sockets
Sep 29 22:45:30 dist-test-slave-00d6 krb5kdc[15424](info): commencing operation
krb5kdc: starting...
W20260929 22:45:31.648103 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:31 dist-test-slave-00d6 krb5kdc[15424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:31.764663 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:38941
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:38941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:31.844830 15438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:31.845084 15438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:31.845132 15438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:31.846268 15438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:31.846335 15438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:31.846359 15438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:31.846383 15438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:31.846411 15438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:31.847863 15438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:38941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:38941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:31.848141 15438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:31.848390 15438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:31.853398 15444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:31.853415 15438 server_base.cc:1034] running on GCE node
W20260929 22:45:31.853398 15446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:31.853506 15443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:31.853925 15438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:31.854216 15438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:31.855388 15438 hybrid_clock.cc:648] HybridClock initialized: now 1790721931855368 us; error 44 us; skew 500 ppm
Sep 29 22:45:31 dist-test-slave-00d6 krb5kdc[15424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721931, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:31.857939 15438 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:31.858419 15438 webserver.cc:460] Webserver started at http://127.12.27.190:41015/ using document root <none> and password file <none>
I20260929 22:45:31.858649 15438 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:31.858716 15438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:31.858860 15438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:31.859977 15438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "729f4ca47cf3417e87f13ccd9cd8e39d"
format_stamp: "Formatted at 2026-09-29 22:45:31 on dist-test-slave-00d6"
server_key: "f24542ee821aa1b30d202f8fbc31dc37"
server_key_iv: "1278a079c0cf2c217b232e412532cb4c"
server_key_version: "encryptionkey@0"
I20260929 22:45:31.860337 15438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "729f4ca47cf3417e87f13ccd9cd8e39d"
format_stamp: "Formatted at 2026-09-29 22:45:31 on dist-test-slave-00d6"
server_key: "f24542ee821aa1b30d202f8fbc31dc37"
server_key_iv: "1278a079c0cf2c217b232e412532cb4c"
server_key_version: "encryptionkey@0"
I20260929 22:45:31.861655 15438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:31.862416 15453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:31.862609 15438 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:31.862707 15438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "729f4ca47cf3417e87f13ccd9cd8e39d"
format_stamp: "Formatted at 2026-09-29 22:45:31 on dist-test-slave-00d6"
server_key: "f24542ee821aa1b30d202f8fbc31dc37"
server_key_iv: "1278a079c0cf2c217b232e412532cb4c"
server_key_version: "encryptionkey@0"
I20260929 22:45:31.862779 15438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:31.884425 15438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:31.886262 15438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:31.886430 15438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:31.890434 15438 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:38941
I20260929 22:45:31.890468 15505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:38941 every 8 connection(s)
I20260929 22:45:31.890844 15438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:31.891840 15506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:31.893967 15506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d: Bootstrap starting.
I20260929 22:45:31.894474 15506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:31.894698 15506 log.cc:824] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:31.895329 15506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d: No bootstrap required, opened a new log
I20260929 22:45:31.896879 15506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38941 } }
I20260929 22:45:31.897020 15506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:31.897043 15506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729f4ca47cf3417e87f13ccd9cd8e39d, State: Initialized, Role: FOLLOWER
I20260929 22:45:31.897140 15506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38941 } }
I20260929 22:45:31.897189 15506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:31.897209 15506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:31.897235 15506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:31.897941 15506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38941 } }
I20260929 22:45:31.898028 15506 leader_election.cc:302] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 729f4ca47cf3417e87f13ccd9cd8e39d; no voters:
I20260929 22:45:31.898141 15506 leader_election.cc:288] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:31.898190 15509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:31.898360 15509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [term 1 LEADER]: Becoming Leader. State: Replica: 729f4ca47cf3417e87f13ccd9cd8e39d, State: Running, Role: LEADER
I20260929 22:45:31.898422 15506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:31.898466 15509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38941 } }
I20260929 22:45:31.898892 15510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38941 } } }
I20260929 22:45:31.898918 15511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 729f4ca47cf3417e87f13ccd9cd8e39d. Latest consensus state: current_term: 1 leader_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729f4ca47cf3417e87f13ccd9cd8e39d" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38941 } } }
I20260929 22:45:31.899055 15510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:31.899066 15511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:31.899298 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15438
I20260929 22:45:31.899387 15518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:31.899420 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:31.899603 12398 external_mini_cluster.cc:1428] Setting key d86f68c4a8308b99270a05a5961bf61d
I20260929 22:45:31.899974 15518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:31.901676 15518 catalog_manager.cc:1347] Generated new cluster ID: 340efe5a360c4fbba7a6f986c27d30fe
I20260929 22:45:31.901727 15518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:31.914116 15518 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:31.914785 15518 catalog_manager.cc:1504] Loading token signing keys...
Sep 29 22:45:31 dist-test-slave-00d6 krb5kdc[15424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:31.921470 15518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 729f4ca47cf3417e87f13ccd9cd8e39d: Generated new TSK 0
I20260929 22:45:31.921648 15518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:45:31.921789 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:31.900241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58380 (local address 127.12.27.190:38941)
0929 22:45:31.900534 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:31.900544 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:31.900577 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:45:31.900687 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:31.900693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:31.900749 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:31.900896 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:31.911770 (+ 10874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:31.913289 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:31.914389 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:31.914988 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:31.915104 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:31.917910 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:31.917914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:31.917915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:31.917928 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:31.919970 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:31.920358 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:31.920361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:31.920362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:31.920468 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:31.920684 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:31.920685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:31.920686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:31.920987 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:31.921145 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:31.921368 (+ 223us) server_negotiation.cc:299] Negotiation successful
0929 22:45:31.921523 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":153,"server-negotiator.queue_time_us":243,"thread_start_us":68,"threads_started":1}
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:31.947981 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:38941
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:32.030021 15532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:32.030227 15532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:32.030251 15532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:32.031334 15532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:32.031370 15532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:32.031395 15532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:32.032877 15532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:38941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:32.033056 15532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:32.033226 15532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:32.038273 15537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:32.038435 15532 server_base.cc:1034] running on GCE node
W20260929 22:45:32.038273 15540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:32.038283 15538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:32.038823 15532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:32.039079 15532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:32.040246 15532 hybrid_clock.cc:648] HybridClock initialized: now 1790721932040232 us; error 42 us; skew 500 ppm
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:32.042701 15532 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:32.043169 15532 webserver.cc:460] Webserver started at http://127.12.27.129:40033/ using document root <none> and password file <none>
I20260929 22:45:32.043395 15532 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:32.043469 15532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:32.043602 15532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:32.044647 15532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "301b59a78c1842f0941166581a4f461a"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "c4940a4217448337dff9dc22f29205b2"
server_key_iv: "331ec4b267dcc956bee6d68065202f51"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.045012 15532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "301b59a78c1842f0941166581a4f461a"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "c4940a4217448337dff9dc22f29205b2"
server_key_iv: "331ec4b267dcc956bee6d68065202f51"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.046312 15532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:45:32.047057 15547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.047241 15532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:32.047341 15532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "301b59a78c1842f0941166581a4f461a"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "c4940a4217448337dff9dc22f29205b2"
server_key_iv: "331ec4b267dcc956bee6d68065202f51"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.047433 15532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:32.059602 15532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:32.061510 15532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:32.061671 15532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:32.061910 15532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:32.062214 15532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:32.062269 15532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.062310 15532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:32.062338 15532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.068478 15532 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:37225
I20260929 22:45:32.068506 15661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:37225 every 8 connection(s)
I20260929 22:45:32.068818 15532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:45:32.072721 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15532
I20260929 22:45:32.072840 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:32.073066 12398 external_mini_cluster.cc:1428] Setting key eebe20683d6ea91df5d3f608d8b82f98
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:32.078354 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.069508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42443 (local address 127.12.27.190:38941)
0929 22:45:32.069575 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:32.069577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:32.069795 (+ 218us) server_negotiation.cc:407] Connection header received
0929 22:45:32.070269 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:32.070270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:32.070280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:32.070333 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:32.071231 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.071807 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.072772 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.073102 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.073178 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.075480 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:32.075481 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:32.075481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:32.075488 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:32.076941 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.077411 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.077412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.077413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.077461 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.077734 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.077734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.077734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.077826 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:32.077873 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:32.078221 (+ 348us) server_negotiation.cc:299] Negotiation successful
0929 22:45:32.078291 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:45:32.078640 15664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.069496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:38941 (local address 127.12.27.129:42443)
0929 22:45:32.069674 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:32.069707 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:32.070183 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:32.070400 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:32.070404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:32.070956 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:32.071151 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:32.071156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.071881 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.071881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:32.072686 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:32.072688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.073211 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.073212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:32.073364 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.073909 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:32.073917 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:32.075371 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:32.077022 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:32.077030 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:32.077032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:32.077336 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:32.077524 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:32.077525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:32.077526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:32.077662 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:32.077889 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:32.077896 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:32.078072 (+ 176us) client_negotiation.cc:769] Sending connection context
0929 22:45:32.078195 (+ 123us) client_negotiation.cc:240] Negotiation successful
0929 22:45:32.078372 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":101,"threads_started":1}
I20260929 22:45:32.079180 15662 heartbeater.cc:347] Connected to a master server at 127.12.27.190:38941
I20260929 22:45:32.079269 15662 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:32.079449 15662 heartbeater.cc:511] Master 127.12.27.190:38941 requested a full tablet report, sending...
I20260929 22:45:32.079964 15470 ts_manager.cc:194] Registered new tserver with Master: 301b59a78c1842f0941166581a4f461a (127.12.27.129:37225)
I20260929 22:45:32.080516 15470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:42443
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:32.097915 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:38941
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:32.177883 15667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:32.178081 15667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:32.178117 15667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:32.179157 15667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:32.179189 15667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:32.179214 15667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:32.180595 15667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:38941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:32.180773 15667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:32.180946 15667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:32.185737 15675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:32.185741 15673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:32.185837 15672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:32.185873 15667 server_base.cc:1034] running on GCE node
I20260929 22:45:32.186192 15667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:32.186426 15667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:32.187564 15667 hybrid_clock.cc:648] HybridClock initialized: now 1790721932187555 us; error 25 us; skew 500 ppm
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:32.190048 15667 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:32.190400 15667 webserver.cc:460] Webserver started at http://127.12.27.130:36995/ using document root <none> and password file <none>
I20260929 22:45:32.190583 15667 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:32.190622 15667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:32.190721 15667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:32.191713 15667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "8d5c5ea10f554ac0bcf8d6f57b236d4a"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "9ef94dac2e71d2fbed3d3d637ec67006"
server_key_iv: "3c94864be997db08197db41e35317b46"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.192015 15667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "8d5c5ea10f554ac0bcf8d6f57b236d4a"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "9ef94dac2e71d2fbed3d3d637ec67006"
server_key_iv: "3c94864be997db08197db41e35317b46"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.193255 15667 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:32.193889 15682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.194060 15667 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:32.194152 15667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "8d5c5ea10f554ac0bcf8d6f57b236d4a"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "9ef94dac2e71d2fbed3d3d637ec67006"
server_key_iv: "3c94864be997db08197db41e35317b46"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.194231 15667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:32.207891 15667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:32.210089 15667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:32.210242 15667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:32.210450 15667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:32.210738 15667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:32.210789 15667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.210829 15667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:32.210856 15667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.216501 15667 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:39711
I20260929 22:45:32.216599 15795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:39711 every 8 connection(s)
I20260929 22:45:32.216871 15667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:32.222788 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15667
I20260929 22:45:32.222903 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:32.223105 12398 external_mini_cluster.cc:1428] Setting key b4d36786045bf8d1c717174954ec5a2c
I20260929 22:45:32.226004 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.217592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:39441 (local address 127.12.27.190:38941)
0929 22:45:32.217667 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:32.217670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:32.217861 (+ 191us) server_negotiation.cc:407] Connection header received
0929 22:45:32.218395 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:32.218396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:32.218408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:32.218469 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:32.219366 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.219942 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.220915 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.221117 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.221209 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.223272 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:32.223273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:32.223274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:32.223281 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:32.224669 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.225086 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.225088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.225089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.225146 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.225388 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.225389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.225390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.225506 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:32.225574 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:32.225836 (+ 262us) server_negotiation.cc:299] Negotiation successful
0929 22:45:32.225913 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 22:45:32.226204 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.217537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:38941 (local address 127.12.27.130:39441)
0929 22:45:32.217731 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:32.217772 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:32.218289 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:32.218539 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:32.218543 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:32.219088 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:32.219268 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:32.219273 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.220035 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.220036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:32.220826 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:32.220828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.221220 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.221221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:32.221346 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.221824 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:32.221832 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:32.223186 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:32.224769 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:32.224776 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:32.224778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:32.224992 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:32.225212 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:32.225213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:32.225214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:32.225322 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:32.225576 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:32.225583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:32.225712 (+ 129us) client_negotiation.cc:769] Sending connection context
0929 22:45:32.225815 (+ 103us) client_negotiation.cc:240] Negotiation successful
0929 22:45:32.225965 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":84,"threads_started":1}
I20260929 22:45:32.226647 15796 heartbeater.cc:347] Connected to a master server at 127.12.27.190:38941
I20260929 22:45:32.226723 15796 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:32.226903 15796 heartbeater.cc:511] Master 127.12.27.190:38941 requested a full tablet report, sending...
I20260929 22:45:32.227310 15470 ts_manager.cc:194] Registered new tserver with Master: 8d5c5ea10f554ac0bcf8d6f57b236d4a (127.12.27.130:39711)
I20260929 22:45:32.227757 15470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:39441
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:32.247849 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:38941
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:32.327404 15801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:32.327602 15801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:32.327682 15801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:32.328797 15801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:32.328835 15801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:32.328861 15801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:32.330197 15801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:38941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:32.330370 15801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:32.330534 15801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:32.335513 15807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:32.335536 15806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:32.335531 15801 server_base.cc:1034] running on GCE node
W20260929 22:45:32.335505 15809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:32.335927 15801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:32.336125 15801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:32.337266 15801 hybrid_clock.cc:648] HybridClock initialized: now 1790721932337241 us; error 43 us; skew 500 ppm
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:32.339711 15801 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:32.340137 15801 webserver.cc:460] Webserver started at http://127.12.27.131:40103/ using document root <none> and password file <none>
I20260929 22:45:32.340325 15801 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:32.340368 15801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:32.340458 15801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:32.341415 15801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "520de78e56384cab95f0283a865f3a88"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "ae8b70be3e5415fcf024f849b117c9bf"
server_key_iv: "343adc8e330d8d139ed0752a526c909b"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.341714 15801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "520de78e56384cab95f0283a865f3a88"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "ae8b70be3e5415fcf024f849b117c9bf"
server_key_iv: "343adc8e330d8d139ed0752a526c909b"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.343124 15801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:45:32.343837 15816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.344157 15801 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:32.344240 15801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "520de78e56384cab95f0283a865f3a88"
format_stamp: "Formatted at 2026-09-29 22:45:32 on dist-test-slave-00d6"
server_key: "ae8b70be3e5415fcf024f849b117c9bf"
server_key_iv: "343adc8e330d8d139ed0752a526c909b"
server_key_version: "encryptionkey@0"
I20260929 22:45:32.344295 15801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:32.360602 15801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:32.362471 15801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:32.362577 15801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:32.362742 15801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:32.363044 15801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:32.363081 15801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.363102 15801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:32.363150 15801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:32.369031 15801 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:39831
I20260929 22:45:32.369124 15930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:39831 every 8 connection(s)
I20260929 22:45:32.369412 15801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:32.372337 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15801
I20260929 22:45:32.372548 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:32.372745 12398 external_mini_cluster.cc:1428] Setting key 84a15a94147e3fd6da0ed2639b3de395
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:32.378928 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.370158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:49819 (local address 127.12.27.190:38941)
0929 22:45:32.370203 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:32.370205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:32.370432 (+ 227us) server_negotiation.cc:407] Connection header received
0929 22:45:32.370953 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:32.370955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:32.370967 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:32.371025 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:32.372029 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.372530 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.373873 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.374077 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.374163 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.376292 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:32.376294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:32.376294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:32.376302 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:32.377510 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.377948 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.377949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.377950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.378029 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.378285 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.378286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.378287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.378405 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:32.378484 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:32.378763 (+ 279us) server_negotiation.cc:299] Negotiation successful
0929 22:45:32.378842 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:45:32.379112 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.370127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:38941 (local address 127.12.27.131:49819)
0929 22:45:32.370298 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:32.370333 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:32.370847 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:32.371099 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:32.371103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:32.371728 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:32.371921 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:32.371926 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.372678 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.372679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:32.373806 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:32.373809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.374173 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.374174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:32.374302 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.374746 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:32.374754 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:32.376196 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:32.377626 (+ 1430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:32.377632 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:32.377634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:32.377855 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:32.378100 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:32.378101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:32.378101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:32.378211 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:32.378487 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:32.378494 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:32.378626 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 22:45:32.378729 (+ 103us) client_negotiation.cc:240] Negotiation successful
0929 22:45:32.378877 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260929 22:45:32.379590 15931 heartbeater.cc:347] Connected to a master server at 127.12.27.190:38941
I20260929 22:45:32.379720 15931 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:32.379876 15931 heartbeater.cc:511] Master 127.12.27.190:38941 requested a full tablet report, sending...
I20260929 22:45:32.380254 15470 ts_manager.cc:194] Registered new tserver with Master: 520de78e56384cab95f0283a865f3a88 (127.12.27.131:39831)
I20260929 22:45:32.380587 15470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:49819
I20260929 22:45:32.384687 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721932, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:32.407403 15528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:32.400315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58386 (local address 127.12.27.190:38941)
0929 22:45:32.400372 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:32.400374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:32.400517 (+ 143us) server_negotiation.cc:407] Connection header received
0929 22:45:32.400605 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:32.400606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:32.400616 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:32.400683 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:32.401265 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.401767 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.402550 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:32.402747 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:32.402821 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:32.405059 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:32.405060 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:32.405060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:32.405067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:32.406466 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.406773 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.406773 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.406774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.406822 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:32.406992 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:32.406992 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:32.406992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:32.407129 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:32.407203 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:32.407281 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 22:45:32.407338 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260929 22:45:32.407675 15470 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58386
I20260929 22:45:32.408128 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15532
I20260929 22:45:32.412801 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15667
I20260929 22:45:32.417469 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15801
I20260929 22:45:32.421429 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15438
2026-09-29T22:45:32Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1814 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15943](info): set up 2 sockets
Sep 29 22:45:32 dist-test-slave-00d6 krb5kdc[15943](info): commencing operation
krb5kdc: starting...
W20260929 22:45:33.448011 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:33 dist-test-slave-00d6 krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:33.562619 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:32811
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:32811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:33.642850 15956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:33.643049 15956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:33.643070 15956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:33.644222 15956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:33.644263 15956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:33.644277 15956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:33.644289 15956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:33.644301 15956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:33.645696 15956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:32811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:32811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:33.645870 15956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:33.646037 15956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:33.650696 15962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:33.650825 15964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:33.650696 15961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:33.650946 15956 server_base.cc:1034] running on GCE node
I20260929 22:45:33.651182 15956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:33.651460 15956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:33.652604 15956 hybrid_clock.cc:648] HybridClock initialized: now 1790721933652593 us; error 34 us; skew 500 ppm
Sep 29 22:45:33 dist-test-slave-00d6 krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:33.655045 15956 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:33.655508 15956 webserver.cc:460] Webserver started at http://127.12.27.190:44833/ using document root <none> and password file <none>
I20260929 22:45:33.655747 15956 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:33.655793 15956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:33.655930 15956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:33.657049 15956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "900b344d22744bc8a739263960e87e36"
format_stamp: "Formatted at 2026-09-29 22:45:33 on dist-test-slave-00d6"
server_key: "f8c4b1bad93bf41892501077293f652c"
server_key_iv: "77cdd80b634ff9a6d77556adc0e532e8"
server_key_version: "encryptionkey@0"
I20260929 22:45:33.657395 15956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "900b344d22744bc8a739263960e87e36"
format_stamp: "Formatted at 2026-09-29 22:45:33 on dist-test-slave-00d6"
server_key: "f8c4b1bad93bf41892501077293f652c"
server_key_iv: "77cdd80b634ff9a6d77556adc0e532e8"
server_key_version: "encryptionkey@0"
I20260929 22:45:33.658668 15956 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:33.659325 15971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:33.659492 15956 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:33.659577 15956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "900b344d22744bc8a739263960e87e36"
format_stamp: "Formatted at 2026-09-29 22:45:33 on dist-test-slave-00d6"
server_key: "f8c4b1bad93bf41892501077293f652c"
server_key_iv: "77cdd80b634ff9a6d77556adc0e532e8"
server_key_version: "encryptionkey@0"
I20260929 22:45:33.659693 15956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:33.672209 15956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:33.674028 15956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:33.674139 15956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:33.678048 15956 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:32811
I20260929 22:45:33.678323 16023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:32811 every 8 connection(s)
I20260929 22:45:33.678436 15956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:33.679175 16024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:33.681653 16024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36: Bootstrap starting.
I20260929 22:45:33.682236 16024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:33.682530 16024 log.cc:824] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:33.683192 16024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36: No bootstrap required, opened a new log
I20260929 22:45:33.684801 16024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "900b344d22744bc8a739263960e87e36" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32811 } }
I20260929 22:45:33.684957 16024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:33.685004 16024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 900b344d22744bc8a739263960e87e36, State: Initialized, Role: FOLLOWER
I20260929 22:45:33.685142 16024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "900b344d22744bc8a739263960e87e36" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32811 } }
I20260929 22:45:33.685221 16024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:33.685264 16024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:33.685312 16024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:33.686100 16024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "900b344d22744bc8a739263960e87e36" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32811 } }
I20260929 22:45:33.686214 16024 leader_election.cc:302] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 900b344d22744bc8a739263960e87e36; no voters:
I20260929 22:45:33.686391 16024 leader_election.cc:288] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:33.686444 16027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:33.686611 16027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [term 1 LEADER]: Becoming Leader. State: Replica: 900b344d22744bc8a739263960e87e36, State: Running, Role: LEADER
I20260929 22:45:33.686638 16024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:33.686738 16027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "900b344d22744bc8a739263960e87e36" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32811 } }
I20260929 22:45:33.687119 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 15956
I20260929 22:45:33.687251 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:33.687451 12398 external_mini_cluster.cc:1428] Setting key d2ee9b90f311de32b87a3a5d03154f06
I20260929 22:45:33.687400 16029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 900b344d22744bc8a739263960e87e36. Latest consensus state: current_term: 1 leader_uuid: "900b344d22744bc8a739263960e87e36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "900b344d22744bc8a739263960e87e36" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32811 } } }
I20260929 22:45:33.687498 16029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:33.687860 16028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "900b344d22744bc8a739263960e87e36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "900b344d22744bc8a739263960e87e36" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32811 } } }
I20260929 22:45:33.687919 16028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:33.687995 16036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:33.688474 16036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:33.690376 16036 catalog_manager.cc:1347] Generated new cluster ID: 7ec1d1a45cb547e59ff9c166071cf4d7
I20260929 22:45:33.690431 16036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:45:33 dist-test-slave-00d6 krb5kdc[15943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:33.704793 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:33.688113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36646 (local address 127.12.27.190:32811)
0929 22:45:33.688415 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:33.688424 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:33.688613 (+ 189us) server_negotiation.cc:407] Connection header received
0929 22:45:33.688754 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:33.688762 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:33.688816 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:33.688999 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:33.690038 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:33.691359 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:33.692480 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:33.693108 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:33.693208 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:33.701170 (+ 7962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:33.701175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:33.701175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:33.701187 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:33.703126 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:33.703508 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:33.703511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:33.703512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:33.703654 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:33.703849 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:33.703850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:33.703850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:33.704163 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:33.704305 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:33.704411 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 22:45:33.704557 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":66,"threads_started":1}
I20260929 22:45:33.705744 16036 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:33.706240 16036 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:33.712139 16036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 900b344d22744bc8a739263960e87e36: Generated new TSK 0
I20260929 22:45:33.712314 16036 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:33.742383 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32811
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:33.847690 16050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:33.847872 16050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:33.847895 16050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:33.849042 16050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:33.849081 16050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:33.849107 16050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:33.850569 16050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:33.850800 16050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:33.851107 16050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:33.856431 16058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:33.856453 16055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:33.856453 16056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:33.856671 16050 server_base.cc:1034] running on GCE node
I20260929 22:45:33.856858 16050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:33.857201 16050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:33.858376 16050 hybrid_clock.cc:648] HybridClock initialized: now 1790721933858370 us; error 35 us; skew 500 ppm
Sep 29 22:45:33 dist-test-slave-00d6 krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:33.861006 16050 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:33.861442 16050 webserver.cc:460] Webserver started at http://127.12.27.129:45297/ using document root <none> and password file <none>
I20260929 22:45:33.861629 16050 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:33.861667 16050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:33.861750 16050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:33.862824 16050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "72c1f7f04efe4f8db3930f922fe9c1dd"
format_stamp: "Formatted at 2026-09-29 22:45:33 on dist-test-slave-00d6"
server_key: "5cd57ad4874892c0f199fc8852cde033"
server_key_iv: "865bc5103471144e0b9ce16fa4178e54"
server_key_version: "encryptionkey@0"
I20260929 22:45:33.863122 16050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "72c1f7f04efe4f8db3930f922fe9c1dd"
format_stamp: "Formatted at 2026-09-29 22:45:33 on dist-test-slave-00d6"
server_key: "5cd57ad4874892c0f199fc8852cde033"
server_key_iv: "865bc5103471144e0b9ce16fa4178e54"
server_key_version: "encryptionkey@0"
I20260929 22:45:33.864480 16050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:33.865126 16065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:33.865320 16050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:33.865401 16050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "72c1f7f04efe4f8db3930f922fe9c1dd"
format_stamp: "Formatted at 2026-09-29 22:45:33 on dist-test-slave-00d6"
server_key: "5cd57ad4874892c0f199fc8852cde033"
server_key_iv: "865bc5103471144e0b9ce16fa4178e54"
server_key_version: "encryptionkey@0"
I20260929 22:45:33.865474 16050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:33.876686 16050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:33.878875 16050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:33.878981 16050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:33.879150 16050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:33.879375 16050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:33.879412 16050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:33.879434 16050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:33.879446 16050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:33.885275 16050 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:38987
I20260929 22:45:33.885334 16178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:38987 every 8 connection(s)
I20260929 22:45:33.885612 16050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:45:33.887591 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16050
I20260929 22:45:33.887717 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:33.887916 12398 external_mini_cluster.cc:1428] Setting key 76ff50fead62b8eadbb3d6a278e7ca19
Sep 29 22:45:33 dist-test-slave-00d6 krb5kdc[15943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:45:33.895584 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:33.886272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:52527 (local address 127.12.27.190:32811)
0929 22:45:33.886356 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:33.886358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:33.886541 (+ 183us) server_negotiation.cc:407] Connection header received
0929 22:45:33.887645 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:33.887647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:33.887661 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:33.887737 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:33.888580 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:33.889081 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:33.890407 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:33.890613 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:33.890670 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:33.892788 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:33.892790 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:33.892790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:33.892798 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:33.894214 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:33.894636 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:33.894637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:33.894638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:33.894699 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:33.894949 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:33.894949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:33.894950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:33.895065 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:33.895138 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:33.895411 (+ 273us) server_negotiation.cc:299] Negotiation successful
0929 22:45:33.895494 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:45:33.895787 16181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:33.886240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:32811 (local address 127.12.27.129:52527)
0929 22:45:33.886412 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:33.886445 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:33.887527 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:33.887838 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:33.887842 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:33.888212 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:33.888489 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:33.888495 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:33.889177 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:33.889178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:33.890313 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:33.890316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:33.890702 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:33.890703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:33.890840 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:33.891328 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:33.891339 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:33.892694 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:33.894317 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:33.894324 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:33.894326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:33.894547 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:33.894765 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:33.894766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:33.894767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:33.894872 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:33.895130 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:33.895136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:33.895272 (+ 136us) client_negotiation.cc:769] Sending connection context
0929 22:45:33.895388 (+ 116us) client_negotiation.cc:240] Negotiation successful
0929 22:45:33.895546 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260929 22:45:33.896256 16179 heartbeater.cc:347] Connected to a master server at 127.12.27.190:32811
I20260929 22:45:33.896346 16179 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:33.896519 16179 heartbeater.cc:511] Master 127.12.27.190:32811 requested a full tablet report, sending...
I20260929 22:45:33.897015 15988 ts_manager.cc:194] Registered new tserver with Master: 72c1f7f04efe4f8db3930f922fe9c1dd (127.12.27.129:38987)
I20260929 22:45:33.897611 15988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:52527
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:33.911823 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32811
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:33.991840 16184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:33.992035 16184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:33.992059 16184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:33.993232 16184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:33.993274 16184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:33.993300 16184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:33.994776 16184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:33.995010 16184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:33.995231 16184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:34.000062 16189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:34.000133 16192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:34.000062 16190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:34.000264 16184 server_base.cc:1034] running on GCE node
I20260929 22:45:34.000494 16184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:34.000756 16184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:34.001899 16184 hybrid_clock.cc:648] HybridClock initialized: now 1790721934001882 us; error 33 us; skew 500 ppm
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:34.004343 16184 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:34.004793 16184 webserver.cc:460] Webserver started at http://127.12.27.130:39275/ using document root <none> and password file <none>
I20260929 22:45:34.005050 16184 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:34.005122 16184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:34.005280 16184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:34.006347 16184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "b71a30a048574c019c509c70b3c301d4"
format_stamp: "Formatted at 2026-09-29 22:45:34 on dist-test-slave-00d6"
server_key: "74e813bf01c52b75265223912e82f63b"
server_key_iv: "8200c61876d4d8cd31097a1b125f9952"
server_key_version: "encryptionkey@0"
I20260929 22:45:34.006745 16184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "b71a30a048574c019c509c70b3c301d4"
format_stamp: "Formatted at 2026-09-29 22:45:34 on dist-test-slave-00d6"
server_key: "74e813bf01c52b75265223912e82f63b"
server_key_iv: "8200c61876d4d8cd31097a1b125f9952"
server_key_version: "encryptionkey@0"
I20260929 22:45:34.008152 16184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:34.008816 16199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:34.008985 16184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:34.009083 16184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "b71a30a048574c019c509c70b3c301d4"
format_stamp: "Formatted at 2026-09-29 22:45:34 on dist-test-slave-00d6"
server_key: "74e813bf01c52b75265223912e82f63b"
server_key_iv: "8200c61876d4d8cd31097a1b125f9952"
server_key_version: "encryptionkey@0"
I20260929 22:45:34.009160 16184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:34.022858 16184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:34.024732 16184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:34.024893 16184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:34.025111 16184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:34.025398 16184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:34.025451 16184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:34.025483 16184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:34.025511 16184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:34.031234 16184 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:42333
I20260929 22:45:34.031283 16313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:42333 every 8 connection(s)
I20260929 22:45:34.031566 16184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:45:34.036124 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16184
I20260929 22:45:34.036207 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:34.036401 12398 external_mini_cluster.cc:1428] Setting key 5ec239952bef015f0c7809bb04a8dc11
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:34.041157 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:34.032301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:52137 (local address 127.12.27.190:32811)
0929 22:45:34.032395 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:34.032397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:34.032587 (+ 190us) server_negotiation.cc:407] Connection header received
0929 22:45:34.033492 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:34.033493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:34.033504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:34.033562 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:34.034123 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.034644 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.035572 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.035822 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.035894 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:34.038265 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:34.038266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:34.038267 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:34.038275 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:34.039801 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.040212 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.040213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.040214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.040273 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.040531 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.040532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.040532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.040643 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:34.040716 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:34.040985 (+ 269us) server_negotiation.cc:299] Negotiation successful
0929 22:45:34.041069 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 22:45:34.041338 16316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:34.032244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:32811 (local address 127.12.27.130:52137)
0929 22:45:34.032458 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:34.032497 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:34.033388 (+ 891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:34.033634 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:34.033637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:34.033880 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:34.034053 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:34.034056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.034721 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.034722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:34.035501 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:34.035504 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.035960 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.035961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:34.036065 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:34.036628 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:34.036636 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:34.038139 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:34.039890 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:34.039896 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:34.039898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:34.040121 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:34.040339 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:34.040340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:34.040340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:34.040456 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:34.040708 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:34.040714 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:34.040850 (+ 136us) client_negotiation.cc:769] Sending connection context
0929 22:45:34.040958 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 22:45:34.041110 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
I20260929 22:45:34.042138 16314 heartbeater.cc:347] Connected to a master server at 127.12.27.190:32811
I20260929 22:45:34.042217 16314 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:34.042403 16314 heartbeater.cc:511] Master 127.12.27.190:32811 requested a full tablet report, sending...
I20260929 22:45:34.042774 15988 ts_manager.cc:194] Registered new tserver with Master: b71a30a048574c019c509c70b3c301d4 (127.12.27.130:42333)
I20260929 22:45:34.043155 15988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:52137
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:34.063036 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32811
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:34.143107 16319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:34.143299 16319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:34.143321 16319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:34.144403 16319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:34.144438 16319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:34.144464 16319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:34.145893 16319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:34.146072 16319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:34.146232 16319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:34.151108 16327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:34.151134 16325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:34.151216 16319 server_base.cc:1034] running on GCE node
W20260929 22:45:34.151108 16324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:34.151696 16319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:34.151978 16319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:34.153151 16319 hybrid_clock.cc:648] HybridClock initialized: now 1790721934153139 us; error 30 us; skew 500 ppm
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:34.155810 16319 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:34.156277 16319 webserver.cc:460] Webserver started at http://127.12.27.131:45845/ using document root <none> and password file <none>
I20260929 22:45:34.156507 16319 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:34.156574 16319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:34.156720 16319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:34.157855 16319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "fdfc4f471fdc4945ab0745d6eb43440c"
format_stamp: "Formatted at 2026-09-29 22:45:34 on dist-test-slave-00d6"
server_key: "1170efc97c7b988b8cc3057fb765752b"
server_key_iv: "485e3356d80e44cc41ec0292790b16fe"
server_key_version: "encryptionkey@0"
I20260929 22:45:34.158218 16319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "fdfc4f471fdc4945ab0745d6eb43440c"
format_stamp: "Formatted at 2026-09-29 22:45:34 on dist-test-slave-00d6"
server_key: "1170efc97c7b988b8cc3057fb765752b"
server_key_iv: "485e3356d80e44cc41ec0292790b16fe"
server_key_version: "encryptionkey@0"
I20260929 22:45:34.159574 16319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:45:34.160358 16334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:34.160537 16319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:34.160634 16319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "fdfc4f471fdc4945ab0745d6eb43440c"
format_stamp: "Formatted at 2026-09-29 22:45:34 on dist-test-slave-00d6"
server_key: "1170efc97c7b988b8cc3057fb765752b"
server_key_iv: "485e3356d80e44cc41ec0292790b16fe"
server_key_version: "encryptionkey@0"
I20260929 22:45:34.160714 16319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:34.182572 16319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:34.184831 16319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:34.184993 16319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:34.185212 16319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:34.185514 16319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:34.185573 16319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:34.185604 16319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:34.185632 16319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:34.191552 16319 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:33641
I20260929 22:45:34.191648 16447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:33641 every 8 connection(s)
I20260929 22:45:34.191939 16319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:34.197819 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16319
I20260929 22:45:34.197907 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:34.198127 12398 external_mini_cluster.cc:1428] Setting key 3b5ac5e35651b2a1a6e92f559d4f5f01
I20260929 22:45:34.200614 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:34.192640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:45905 (local address 127.12.27.190:32811)
0929 22:45:34.192713 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:34.192716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:34.192873 (+ 157us) server_negotiation.cc:407] Connection header received
0929 22:45:34.193742 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:34.193743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:34.193753 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:34.193803 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:34.194336 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.194807 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.195802 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.195976 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.196032 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:34.197992 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:34.198010 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:34.198010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:34.198019 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:34.199536 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.199923 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.199923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.199924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.199978 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.200152 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.200152 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.200152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.200245 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:34.200293 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:34.200497 (+ 204us) server_negotiation.cc:299] Negotiation successful
0929 22:45:34.200554 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:45:34.200747 16450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:34.192607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:32811 (local address 127.12.27.131:45905)
0929 22:45:34.192750 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:34.192782 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:34.193657 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:34.193855 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:34.193858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:34.194097 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:34.194270 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:34.194274 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.194877 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.194878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:34.195736 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:34.195739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.196049 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.196050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:34.196140 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:34.196523 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:34.196531 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:34.197846 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:34.199602 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:34.199607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:34.199608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:34.199858 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:34.200021 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:34.200022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:34.200022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:34.200103 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:34.200284 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:34.200287 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:34.200383 (+ 96us) client_negotiation.cc:769] Sending connection context
0929 22:45:34.200455 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:45:34.200566 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":88,"threads_started":1}
I20260929 22:45:34.201193 16448 heartbeater.cc:347] Connected to a master server at 127.12.27.190:32811
I20260929 22:45:34.201280 16448 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:34.201404 16448 heartbeater.cc:511] Master 127.12.27.190:32811 requested a full tablet report, sending...
I20260929 22:45:34.201699 15988 ts_manager.cc:194] Registered new tserver with Master: fdfc4f471fdc4945ab0745d6eb43440c (127.12.27.131:33641)
I20260929 22:45:34.202013 15988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:45905
I20260929 22:45:34.209873 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:34.232098 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:34.224456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48192 (local address 127.12.27.129:38987)
0929 22:45:34.224623 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:34.224627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:34.224637 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:34.224662 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:34.224664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:34.224677 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:34.224742 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:34.225278 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.225990 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.226689 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.227004 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.227058 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:34.229217 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:34.229225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:34.229225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:34.229231 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:34.230877 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.231216 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.231219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.231219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.231284 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.231505 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.231505 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.231505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.231679 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:34.231815 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:34.231910 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 22:45:34.231973 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[15943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:34.239894 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:34.233305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36648 (local address 127.12.27.190:32811)
0929 22:45:34.233354 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:34.233357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:34.233366 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:34.233426 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:34.233427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:34.233437 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:34.233487 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:34.233963 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.234439 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.235118 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:34.235322 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:34.235404 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:34.237512 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:34.237513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:34.237513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:34.237521 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:34.238678 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.239035 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.239036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.239036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.239095 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:34.239309 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:34.239310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:34.239310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:34.239462 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:34.239567 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:34.239709 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 22:45:34.239783 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 22:45:34.240183 15988 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36648
I20260929 22:45:34.240574 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16050
I20260929 22:45:34.245254 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16184
I20260929 22:45:34.249595 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16319
I20260929 22:45:34.253372 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 15956
2026-09-29T22:45:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1831 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[16460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[16460](info): set up 2 sockets
Sep 29 22:45:34 dist-test-slave-00d6 krb5kdc[16460](info): commencing operation
krb5kdc: starting...
W20260929 22:45:35.292182 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:35.411778 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45295
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:45295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:35.493134 16473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:35.493366 16473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:35.493403 16473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:35.494544 16473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:35.494609 16473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:35.494637 16473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:35.494666 16473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:35.494691 16473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:35.496241 16473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:45295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:35.496510 16473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:35.496727 16473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:35.501581 16479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:35.501562 16478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:35.501554 16481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:35.501603 16473 server_base.cc:1034] running on GCE node
I20260929 22:45:35.501945 16473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:35.502269 16473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:35.503443 16473 hybrid_clock.cc:648] HybridClock initialized: now 1790721935503421 us; error 38 us; skew 500 ppm
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:35.505931 16473 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:35.506294 16473 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:35.506366 16473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:35.506521 16473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:35.507581 16473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "aef2c0dcd49941a69c187d31664d9080"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "3cfb33b0f9f4eb3900ce050fa62af07f"
server_key_iv: "0166ecb74196fc7df0abea1020555c84"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.508024 16473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "aef2c0dcd49941a69c187d31664d9080"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "3cfb33b0f9f4eb3900ce050fa62af07f"
server_key_iv: "0166ecb74196fc7df0abea1020555c84"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.509371 16473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:35.510062 16487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.510226 16473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:35.510330 16473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "aef2c0dcd49941a69c187d31664d9080"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "3cfb33b0f9f4eb3900ce050fa62af07f"
server_key_iv: "0166ecb74196fc7df0abea1020555c84"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.510404 16473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:35.519856 16473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:35.521606 16473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:35.521766 16473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:35.525635 16473 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:45295
I20260929 22:45:35.525665 16539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:45295 every 8 connection(s)
I20260929 22:45:35.525934 16473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:35.526409 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16473
I20260929 22:45:35.526537 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:35.526711 12398 external_mini_cluster.cc:1428] Setting key 16d1199ad3dec1132ae42f258c00da55
I20260929 22:45:35.527004 16540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:35.530370 16540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080: Bootstrap starting.
I20260929 22:45:35.531028 16540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:35.531317 16540 log.cc:824] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:35.532097 16540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080: No bootstrap required, opened a new log
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:35.534171 16540 raft_consensus.cc:348] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef2c0dcd49941a69c187d31664d9080" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45295 } }
I20260929 22:45:35.534303 16540 raft_consensus.cc:374] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:35.534325 16540 raft_consensus.cc:729] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef2c0dcd49941a69c187d31664d9080, State: Initialized, Role: FOLLOWER
I20260929 22:45:35.534461 16540 consensus_queue.cc:260] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef2c0dcd49941a69c187d31664d9080" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45295 } }
I20260929 22:45:35.534535 16540 raft_consensus.cc:388] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:35.534559 16540 raft_consensus.cc:482] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:35.534623 16540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:35.535343 16540 raft_consensus.cc:504] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef2c0dcd49941a69c187d31664d9080" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45295 } }
I20260929 22:45:35.535455 16540 leader_election.cc:302] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aef2c0dcd49941a69c187d31664d9080; no voters:
I20260929 22:45:35.535699 16540 leader_election.cc:288] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:35.535714 16545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:35.535842 16545 raft_consensus.cc:686] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [term 1 LEADER]: Becoming Leader. State: Replica: aef2c0dcd49941a69c187d31664d9080, State: Running, Role: LEADER
I20260929 22:45:35.535930 16545 consensus_queue.cc:237] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef2c0dcd49941a69c187d31664d9080" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45295 } }
I20260929 22:45:35.535979 16540 sys_catalog.cc:564] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:35.536337 16546 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aef2c0dcd49941a69c187d31664d9080. Latest consensus state: current_term: 1 leader_uuid: "aef2c0dcd49941a69c187d31664d9080" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef2c0dcd49941a69c187d31664d9080" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45295 } } }
I20260929 22:45:35.536353 16547 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aef2c0dcd49941a69c187d31664d9080" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef2c0dcd49941a69c187d31664d9080" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45295 } } }
I20260929 22:45:35.536470 16546 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:35.536736 16547 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:35.537218 16552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:35.537705 16552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:35.538287 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:35.527193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60602 (local address 127.12.27.190:45295)
0929 22:45:35.527362 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:35.527371 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:35.527401 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:45:35.527996 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:35.528006 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:35.528070 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:35.528215 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:35.528798 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.530135 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.530967 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.531587 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.531760 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:35.534471 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:35.534475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:35.534476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:35.534488 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:35.536642 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:35.537044 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:35.537047 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:35.537047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:35.537159 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:35.537388 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:35.537389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:35.537389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:35.537702 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:35.537842 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:35.537982 (+ 140us) server_negotiation.cc:299] Negotiation successful
0929 22:45:35.538131 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260929 22:45:35.539369 16552 catalog_manager.cc:1347] Generated new cluster ID: 0d7b3fc981724257bcb1593617dc509d
I20260929 22:45:35.539431 16552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:35.545451 16552 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:35.545982 16552 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:35.553262 16552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080: Generated new TSK 0
I20260929 22:45:35.553454 16552 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:35.586866 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45295
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:35.692777 16566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:35.692998 16566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:35.693022 16566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:35.694155 16566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:35.694196 16566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:35.694223 16566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:35.695760 16566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:35.695995 16566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:35.696224 16566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:35.701247 16572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:35.701231 16571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:35.701252 16566 server_base.cc:1034] running on GCE node
W20260929 22:45:35.701233 16574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:35.701668 16566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:35.701916 16566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:35.703056 16566 hybrid_clock.cc:648] HybridClock initialized: now 1790721935703038 us; error 38 us; skew 500 ppm
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:35.705681 16566 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:35.705976 16566 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:35.706022 16566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:35.706111 16566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:35.707113 16566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "1463fd5e68bc49f89bb15acb4a15a5ae"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "3f1f1c311272afe0fa4771f48115287e"
server_key_iv: "39c5cc86fa2291b4ab24b58de8259e4b"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.707415 16566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "1463fd5e68bc49f89bb15acb4a15a5ae"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "3f1f1c311272afe0fa4771f48115287e"
server_key_iv: "39c5cc86fa2291b4ab24b58de8259e4b"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.708742 16566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:35.709523 16580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.709681 16566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:35.709764 16566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "1463fd5e68bc49f89bb15acb4a15a5ae"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "3f1f1c311272afe0fa4771f48115287e"
server_key_iv: "39c5cc86fa2291b4ab24b58de8259e4b"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.709817 16566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:35.730791 16566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:35.732785 16566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:35.732909 16566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:35.733112 16566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:35.733426 16566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:35.733459 16566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.733484 16566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:35.733529 16566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.739440 16566 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:40887
I20260929 22:45:35.739526 16694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:40887 every 8 connection(s)
I20260929 22:45:35.739823 16566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:45:35.742337 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16566
I20260929 22:45:35.742460 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:35.742650 12398 external_mini_cluster.cc:1428] Setting key 1535361b385885cad06d5bdeab3f0254
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:35.750075 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:35.740550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:55615 (local address 127.12.27.190:45295)
0929 22:45:35.740618 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:35.740620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:35.740824 (+ 204us) server_negotiation.cc:407] Connection header received
0929 22:45:35.741380 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:35.741381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:35.741393 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:35.741444 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:35.742518 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.743080 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.744254 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.744587 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.744666 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:35.747201 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:35.747203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:35.747203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:35.747209 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:35.748636 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:35.749130 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:35.749131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:35.749131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:35.749181 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:35.749463 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:35.749464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:35.749464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:35.749560 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:35.749610 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:35.749939 (+ 329us) server_negotiation.cc:299] Negotiation successful
0929 22:45:35.750013 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:45:35.750370 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:35.740522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45295 (local address 127.12.27.129:55615)
0929 22:45:35.740705 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:35.740742 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:35.741265 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:35.741512 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:35.741517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:35.741781 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:35.742419 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:35.742428 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.743171 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.743172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:35.744171 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:35.744173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.744686 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.744687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:35.744839 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:35.745355 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:35.745364 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:35.747096 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:35.748718 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:35.748725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:35.748728 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:35.749049 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:35.749247 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:35.749248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:35.749249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:35.749398 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:35.749626 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:35.749633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:35.749800 (+ 167us) client_negotiation.cc:769] Sending connection context
0929 22:45:35.749924 (+ 124us) client_negotiation.cc:240] Negotiation successful
0929 22:45:35.750104 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260929 22:45:35.750952 16695 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45295
I20260929 22:45:35.751047 16695 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:45:35.751211 16695 heartbeater.cc:511] Master 127.12.27.190:45295 requested a full tablet report, sending...
I20260929 22:45:35.751773 16504 ts_manager.cc:194] Registered new tserver with Master: 1463fd5e68bc49f89bb15acb4a15a5ae (127.12.27.129:40887)
I20260929 22:45:35.752425 16504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:55615
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:35.768636 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45295
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:35.850379 16700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:35.850627 16700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:35.850666 16700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:35.851887 16700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:35.851946 16700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:35.851998 16700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:35.853513 16700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:35.853770 16700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:35.854004 16700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:35.858973 16708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:35.859009 16705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:35.858999 16706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:35.859223 16700 server_base.cc:1034] running on GCE node
I20260929 22:45:35.859432 16700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:35.859704 16700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:35.860873 16700 hybrid_clock.cc:648] HybridClock initialized: now 1790721935860848 us; error 37 us; skew 500 ppm
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:35.863479 16700 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:35.863891 16700 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:35.863962 16700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:35.864131 16700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:35.865140 16700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "3c7f34c2166843758fa5bcec4ccf6fce"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "53f0d4c1c161fcb12933cb3cba452f3a"
server_key_iv: "ad10a8a79cefd94052bc975aa68ed1e2"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.865496 16700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "3c7f34c2166843758fa5bcec4ccf6fce"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "53f0d4c1c161fcb12933cb3cba452f3a"
server_key_iv: "ad10a8a79cefd94052bc975aa68ed1e2"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.866789 16700 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:35.867537 16714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.867729 16700 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:45:35.867815 16700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "3c7f34c2166843758fa5bcec4ccf6fce"
format_stamp: "Formatted at 2026-09-29 22:45:35 on dist-test-slave-00d6"
server_key: "53f0d4c1c161fcb12933cb3cba452f3a"
server_key_iv: "ad10a8a79cefd94052bc975aa68ed1e2"
server_key_version: "encryptionkey@0"
I20260929 22:45:35.867897 16700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:35.888118 16700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:35.889971 16700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:35.890136 16700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:35.890367 16700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:35.890676 16700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:35.890730 16700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.890771 16700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:35.890799 16700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:35.896586 16700 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:34849
I20260929 22:45:35.896621 16827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:34849 every 8 connection(s)
I20260929 22:45:35.896876 16700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:45:35 dist-test-slave-00d6 krb5kdc[16460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:35.903543 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16700
I20260929 22:45:35.903687 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:35.903924 12398 external_mini_cluster.cc:1428] Setting key 79dafeebeb4bd69b0319e116906f0510
I20260929 22:45:35.906422 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:35.897535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:33515 (local address 127.12.27.190:45295)
0929 22:45:35.897611 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:35.897613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:35.897809 (+ 196us) server_negotiation.cc:407] Connection header received
0929 22:45:35.898388 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:35.898389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:35.898399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:35.898457 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:35.899316 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.899914 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.900849 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.901024 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.901073 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:35.903227 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:35.903229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:35.903229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:35.903235 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:35.904864 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:35.905341 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:35.905342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:35.905343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:35.905412 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:35.905690 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:35.905691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:35.905691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:35.905797 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:35.905854 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:35.906198 (+ 344us) server_negotiation.cc:299] Negotiation successful
0929 22:45:35.906282 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 22:45:35.906437 16830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:35.897507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45295 (local address 127.12.27.130:33515)
0929 22:45:35.897686 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:35.897723 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:35.898278 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:35.898515 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:35.898519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:35.898765 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:35.899241 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:35.899245 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.899994 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.899995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:35.900776 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:35.900778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:35.901115 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:35.901116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:35.901224 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:35.901684 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:35.901692 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:35.903141 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:35.904940 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:35.904947 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:35.904949 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:35.905262 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:35.905481 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:35.905481 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:35.905482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:35.905619 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:35.905864 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:35.905869 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:35.906042 (+ 173us) client_negotiation.cc:769] Sending connection context
0929 22:45:35.906164 (+ 122us) client_negotiation.cc:240] Negotiation successful
0929 22:45:35.906279 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
I20260929 22:45:35.906922 16828 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45295
I20260929 22:45:35.907028 16828 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:35.907192 16828 heartbeater.cc:511] Master 127.12.27.190:45295 requested a full tablet report, sending...
I20260929 22:45:35.907586 16504 ts_manager.cc:194] Registered new tserver with Master: 3c7f34c2166843758fa5bcec4ccf6fce (127.12.27.130:34849)
I20260929 22:45:35.907997 16504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:33515
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:35.930019 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45295
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:41393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:36.010795 16833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:36.011044 16833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:36.011085 16833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:36.012256 16833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:36.012323 16833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:36.012372 16833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:36.014047 16833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:36.014313 16833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:36.014550 16833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:36.019449 16841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.019467 16839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.019464 16838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.019666 16833 server_base.cc:1034] running on GCE node
I20260929 22:45:36.019866 16833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:36.020110 16833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:36.021275 16833 hybrid_clock.cc:648] HybridClock initialized: now 1790721936021260 us; error 26 us; skew 500 ppm
Sep 29 22:45:36 dist-test-slave-00d6 krb5kdc[16460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:36.023754 16833 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:36.024062 16833 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:36.024106 16833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:36.024231 16833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:36.025224 16833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "2af6bfc722e400e661aeb29f6ad2ffd8"
server_key_iv: "fc1c2ccfc60ac1dff58731962bd15f3f"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.025508 16833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "2af6bfc722e400e661aeb29f6ad2ffd8"
server_key_iv: "fc1c2ccfc60ac1dff58731962bd15f3f"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.026696 16833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:36.027345 16847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.027494 16833 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:36.027572 16833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "2af6bfc722e400e661aeb29f6ad2ffd8"
server_key_iv: "fc1c2ccfc60ac1dff58731962bd15f3f"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.027666 16833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:36.048274 16833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:36.050557 16833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:36.050705 16833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:36.050956 16833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:36.051278 16833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:36.051333 16833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.051375 16833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:36.051403 16833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.057288 16833 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:41277
I20260929 22:45:36.057360 16960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:41277 every 8 connection(s)
I20260929 22:45:36.057639 16833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:45:36 dist-test-slave-00d6 krb5kdc[16460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:36.064793 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 16833
I20260929 22:45:36.064894 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:36.065146 12398 external_mini_cluster.cc:1428] Setting key 00dc95ed08ce2acc4b8498b540f8d5f2
I20260929 22:45:36.067517 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.058362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:34347 (local address 127.12.27.190:45295)
0929 22:45:36.058405 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.058407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.058606 (+ 199us) server_negotiation.cc:407] Connection header received
0929 22:45:36.059042 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.059043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.059053 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.059105 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.060358 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.060860 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.061900 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.062163 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.062245 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.064511 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.064513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.064513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:36.064521 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.066147 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:36.066544 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:36.066545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:36.066545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:36.066607 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:36.066857 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:36.066858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:36.066859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:36.066981 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.067058 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.067334 (+ 276us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.067419 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:45:36.067710 16963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.058338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45295 (local address 127.12.27.131:34347)
0929 22:45:36.058480 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.058514 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.058962 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.059157 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.059160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.059411 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.060202 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.060209 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.060976 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.060977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.061795 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.061797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.062249 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.062251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.062393 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.062926 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:36.062934 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.064372 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.066224 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:36.066230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:36.066233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:36.066454 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:36.066673 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:36.066674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:36.066674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:36.066789 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:36.067050 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.067056 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.067196 (+ 140us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.067301 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.067456 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
I20260929 22:45:36.068163 16961 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45295
I20260929 22:45:36.068243 16961 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:36.068351 16961 heartbeater.cc:511] Master 127.12.27.190:45295 requested a full tablet report, sending...
I20260929 22:45:36.068668 16504 ts_manager.cc:194] Registered new tserver with Master: 44cd55fdf6074070a8a6e6bf8c3cdbbb (127.12.27.131:41277)
I20260929 22:45:36.069049 16504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:34347
I20260929 22:45:36.076823 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:45:36.084076 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.078098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60610 (local address 127.12.27.190:45295)
0929 22:45:36.078160 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.078162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.078271 (+ 109us) server_negotiation.cc:407] Connection header received
0929 22:45:36.078310 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.078311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.078320 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.078362 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.078848 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.079321 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.080053 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.080227 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.080280 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.081339 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.081340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.081340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:36.081347 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.082727 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:36.083183 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:36.083185 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:36.083185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:36.083251 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:36.083435 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:36.083436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:36.083436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:36.083584 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.083743 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.083807 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.083955 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:45:36.085695 16504 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60610:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:36.087237 16504 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:36.093533 16977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.089851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48010 (local address 127.12.27.131:41277)
0929 22:45:36.090030 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.090034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.090044 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:36.090080 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.090082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.090096 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.090166 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:36.090343 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.091072 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.092519 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.093107 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.093192 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.093260 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.093418 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.093455 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260929 22:45:36.093528 16976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.089642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:41277 (local address 127.0.0.1:48010)
0929 22:45:36.089898 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.089907 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.089943 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.090166 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.090167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.090169 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:36.090222 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.090224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.091170 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.091171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.092425 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.092428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.093207 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.093208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.093287 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.093301 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.093401 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.093456 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":67,"threads_started":1}
I20260929 22:45:36.093631 16972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.089421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:40887 (local address 127.0.0.1:55754)
0929 22:45:36.089738 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.089747 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.089822 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.090051 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.090055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.090057 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:36.090141 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.090144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.091608 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.091608 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.092501 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.092503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.093415 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.093416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.093485 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.093489 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.093517 (+ 28us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.093554 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":1,"thread_start_us":90,"threads_started":1}
I20260929 22:45:36.093887 16973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.089420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:34849 (local address 127.0.0.1:41258)
0929 22:45:36.089597 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.089639 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.089706 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.090228 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.090228 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.090231 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:36.090274 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.090275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.091580 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.091581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.092654 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.092656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.093484 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.093484 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.093538 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.093541 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.093580 (+ 39us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.093611 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":74,"threads_started":1}
I20260929 22:45:36.094036 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.089595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55754 (local address 127.12.27.129:40887)
0929 22:45:36.089872 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.089876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.089884 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:36.089915 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.089916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.089928 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.090031 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:36.090310 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.091468 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.092600 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.093312 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.093831 (+ 519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.093895 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.093921 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.093964 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":73,"threads_started":1}
I20260929 22:45:36.094190 16974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.089552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41258 (local address 127.12.27.130:34849)
0929 22:45:36.090057 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.090062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.090071 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:36.090106 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.090108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.090124 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.090349 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:36.090426 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.091468 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.092732 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.093401 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.093987 (+ 586us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.094045 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.094069 (+ 24us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.094111 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":84,"threads_started":1}
I20260929 22:45:36.094391 16895 tablet_service.cc:1467] Processing CreateTablet for tablet 8f27e6c4d795408b9713c15a6eff0b10 (DEFAULT_TABLE table=test-table [id=e976e46138d34beeb4e1c159f15879af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:36.094777 16895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f27e6c4d795408b9713c15a6eff0b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.094798 16762 tablet_service.cc:1467] Processing CreateTablet for tablet 8f27e6c4d795408b9713c15a6eff0b10 (DEFAULT_TABLE table=test-table [id=e976e46138d34beeb4e1c159f15879af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:36.095093 16762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f27e6c4d795408b9713c15a6eff0b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.095032 16628 tablet_service.cc:1467] Processing CreateTablet for tablet 8f27e6c4d795408b9713c15a6eff0b10 (DEFAULT_TABLE table=test-table [id=e976e46138d34beeb4e1c159f15879af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:36.095350 16628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f27e6c4d795408b9713c15a6eff0b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.097954 16978 tablet_bootstrap.cc:492] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Bootstrap starting.
I20260929 22:45:36.098219 16979 tablet_bootstrap.cc:492] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Bootstrap starting.
I20260929 22:45:36.098387 16980 tablet_bootstrap.cc:492] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Bootstrap starting.
I20260929 22:45:36.098737 16978 tablet_bootstrap.cc:654] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.098874 16979 tablet_bootstrap.cc:654] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.098999 16980 tablet_bootstrap.cc:654] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.099381 16978 log.cc:824] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.099413 16979 log.cc:824] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.099611 16980 log.cc:824] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.100183 16979 tablet_bootstrap.cc:492] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: No bootstrap required, opened a new log
I20260929 22:45:36.100255 16979 ts_tablet_manager.cc:1397] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:45:36.100334 16978 tablet_bootstrap.cc:492] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: No bootstrap required, opened a new log
I20260929 22:45:36.100358 16980 tablet_bootstrap.cc:492] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: No bootstrap required, opened a new log
I20260929 22:45:36.100397 16978 ts_tablet_manager.cc:1397] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:45:36.100405 16980 ts_tablet_manager.cc:1397] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:45:36.101886 16978 raft_consensus.cc:348] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.102041 16978 raft_consensus.cc:374] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.102084 16978 raft_consensus.cc:729] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1463fd5e68bc49f89bb15acb4a15a5ae, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.102192 16978 consensus_queue.cc:260] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.102308 16980 raft_consensus.cc:348] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.102303 16979 raft_consensus.cc:348] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.102468 16980 raft_consensus.cc:374] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.102468 16979 raft_consensus.cc:374] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.102483 16978 ts_tablet_manager.cc:1428] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:45:36.102505 16980 raft_consensus.cc:729] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7f34c2166843758fa5bcec4ccf6fce, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.102505 16979 raft_consensus.cc:729] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44cd55fdf6074070a8a6e6bf8c3cdbbb, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.102613 16980 consensus_queue.cc:260] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.102648 16695 heartbeater.cc:503] Master 127.12.27.190:45295 was elected leader, sending a full tablet report...
I20260929 22:45:36.102627 16979 consensus_queue.cc:260] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.102886 16980 ts_tablet_manager.cc:1428] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 22:45:36.102887 16979 ts_tablet_manager.cc:1428] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:36.103016 16828 heartbeater.cc:503] Master 127.12.27.190:45295 was elected leader, sending a full tablet report...
I20260929 22:45:36.103055 16961 heartbeater.cc:503] Master 127.12.27.190:45295 was elected leader, sending a full tablet report...
W20260929 22:45:36.147379 16829 tablet.cc:2369] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:36.218078 16986 raft_consensus.cc:482] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:36.218222 16986 raft_consensus.cc:504] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.218602 16986 leader_election.cc:288] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1463fd5e68bc49f89bb15acb4a15a5ae (127.12.27.129:40887), 44cd55fdf6074070a8a6e6bf8c3cdbbb (127.12.27.131:41277)
I20260929 22:45:36.222536 16977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.218874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:38291 (local address 127.12.27.131:41277)
0929 22:45:36.218922 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.218924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.218936 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:45:36.218974 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.218974 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.218985 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.219063 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:36.219243 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.220043 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.221544 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.222117 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.222206 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.222217 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.222416 (+ 199us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.222462 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:45:36.222536 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.218961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:40639 (local address 127.12.27.129:40887)
0929 22:45:36.219009 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.219011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.219128 (+ 117us) server_negotiation.cc:407] Connection header received
0929 22:45:36.219160 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.219161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.219168 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.219232 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:36.219355 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.220076 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.221544 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.222165 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.222230 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.222238 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.222416 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.222468 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:36.222568 16987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.218820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:40887 (local address 127.12.27.130:40639)
0929 22:45:36.219041 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.219051 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.219098 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.219235 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.219236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.219238 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:36.219292 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.219293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.220147 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.220148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.221431 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.221433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.222240 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.222240 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.222307 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.222311 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.222370 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.222421 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":103,"thread_start_us":125,"threads_started":1}
I20260929 22:45:36.222570 16830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.218797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:41277 (local address 127.12.27.130:38291)
0929 22:45:36.218859 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.218873 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.218922 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.219074 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.219075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.219077 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:36.219152 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.219154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.220133 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.220134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.221431 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:36.221433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.222226 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.222227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:36.222310 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.222311 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.222370 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.222421 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":61}
I20260929 22:45:36.223045 16649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f27e6c4d795408b9713c15a6eff0b10" candidate_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" is_pre_election: true
I20260929 22:45:36.223109 16915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f27e6c4d795408b9713c15a6eff0b10" candidate_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" is_pre_election: true
I20260929 22:45:36.223237 16649 raft_consensus.cc:2454] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7f34c2166843758fa5bcec4ccf6fce in term 0.
I20260929 22:45:36.223237 16915 raft_consensus.cc:2454] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c7f34c2166843758fa5bcec4ccf6fce in term 0.
I20260929 22:45:36.223479 16715 leader_election.cc:302] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1463fd5e68bc49f89bb15acb4a15a5ae, 3c7f34c2166843758fa5bcec4ccf6fce; no voters:
I20260929 22:45:36.223606 16986 raft_consensus.cc:2781] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:36.223686 16986 raft_consensus.cc:482] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:36.223716 16986 raft_consensus.cc:3037] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:36.224370 16986 raft_consensus.cc:504] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.224520 16986 leader_election.cc:288] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [CANDIDATE]: Term 1 election: Requested vote from peers 1463fd5e68bc49f89bb15acb4a15a5ae (127.12.27.129:40887), 44cd55fdf6074070a8a6e6bf8c3cdbbb (127.12.27.131:41277)
I20260929 22:45:36.224663 16649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f27e6c4d795408b9713c15a6eff0b10" candidate_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae"
I20260929 22:45:36.224661 16915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f27e6c4d795408b9713c15a6eff0b10" candidate_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb"
I20260929 22:45:36.224761 16649 raft_consensus.cc:3037] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:36.224756 16915 raft_consensus.cc:3037] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:36.225422 16649 raft_consensus.cc:2454] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7f34c2166843758fa5bcec4ccf6fce in term 1.
I20260929 22:45:36.225553 16915 raft_consensus.cc:2454] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c7f34c2166843758fa5bcec4ccf6fce in term 1.
I20260929 22:45:36.225606 16715 leader_election.cc:302] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1463fd5e68bc49f89bb15acb4a15a5ae, 3c7f34c2166843758fa5bcec4ccf6fce; no voters:
I20260929 22:45:36.225714 16986 raft_consensus.cc:2781] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:36.225893 16986 raft_consensus.cc:686] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 1 LEADER]: Becoming Leader. State: Replica: 3c7f34c2166843758fa5bcec4ccf6fce, State: Running, Role: LEADER
I20260929 22:45:36.226001 16986 consensus_queue.cc:237] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } }
I20260929 22:45:36.226886 16503 catalog_manager.cc:5495] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c7f34c2166843758fa5bcec4ccf6fce (127.12.27.130). New cstate: current_term: 1 leader_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c7f34c2166843758fa5bcec4ccf6fce" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 34849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:36.238134 16974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.235579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41272 (local address 127.12.27.130:34849)
0929 22:45:36.235646 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.235648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.235657 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:36.235754 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.235755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.235770 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.235827 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:36.235934 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.236469 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.237376 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:36.237564 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:36.237638 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:36.237810 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:36.237908 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:36.238012 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.238030 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.238048 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:45:36.239794 16915 raft_consensus.cc:1261] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 1 FOLLOWER]: Refusing update from remote peer 3c7f34c2166843758fa5bcec4ccf6fce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:36.239796 16649 raft_consensus.cc:1261] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 1 FOLLOWER]: Refusing update from remote peer 3c7f34c2166843758fa5bcec4ccf6fce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:36.240159 16988 consensus_queue.cc:1035] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "44cd55fdf6074070a8a6e6bf8c3cdbbb" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 41277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:36.240298 16986 consensus_queue.cc:1035] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1463fd5e68bc49f89bb15acb4a15a5ae" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:45:36.240501 16696 tablet.cc:2369] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:36.245239 16504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:36.245357 16504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:36.246135 16504 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aef2c0dcd49941a69c187d31664d9080: Sending DeleteTablet for 3 replicas of tablet 8f27e6c4d795408b9713c15a6eff0b10
I20260929 22:45:36.246464 16628 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f27e6c4d795408b9713c15a6eff0b10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:55754
I20260929 22:45:36.246533 16762 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f27e6c4d795408b9713c15a6eff0b10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:41258
I20260929 22:45:36.246738 17001 tablet_replica.cc:330] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: stopping tablet replica
I20260929 22:45:36.246745 16895 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f27e6c4d795408b9713c15a6eff0b10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:48010
I20260929 22:45:36.246845 17001 raft_consensus.cc:2229] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:36.246960 17001 raft_consensus.cc:2258] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:36.246986 17003 tablet_replica.cc:330] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: stopping tablet replica
I20260929 22:45:36.247162 17003 raft_consensus.cc:2229] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:36.247161 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16566
I20260929 22:45:36.247310 17003 raft_consensus.cc:2258] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:36.247400 17001 ts_tablet_manager.cc:1905] T 8f27e6c4d795408b9713c15a6eff0b10 P 1463fd5e68bc49f89bb15acb4a15a5ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:36.251786 17002 tablet_replica.cc:330] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: stopping tablet replica
I20260929 22:45:36.251922 17002 raft_consensus.cc:2229] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:36.252068 17002 raft_consensus.cc:2258] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:36.252285 17003 ts_tablet_manager.cc:1905] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:36.252535 17002 ts_tablet_manager.cc:1905] T 8f27e6c4d795408b9713c15a6eff0b10 P 3c7f34c2166843758fa5bcec4ccf6fce: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:45:36.253540 16488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:40887 (error 108)
I20260929 22:45:36.253847 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16700
I20260929 22:45:36.254616 17003 ts_tablet_manager.cc:1918] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:36.254788 17003 log.cc:1196] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/8f27e6c4d795408b9713c15a6eff0b10
I20260929 22:45:36.255122 17003 ts_tablet_manager.cc:1939] T 8f27e6c4d795408b9713c15a6eff0b10 P 44cd55fdf6074070a8a6e6bf8c3cdbbb: Deleting consensus metadata
I20260929 22:45:36.255694 16491 catalog_manager.cc:4841] TS 44cd55fdf6074070a8a6e6bf8c3cdbbb (127.12.27.131:41277): tablet 8f27e6c4d795408b9713c15a6eff0b10 (table test-table [id=e976e46138d34beeb4e1c159f15879af]) successfully deleted
I20260929 22:45:36.255707 16973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.255555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:40887 (local address 127.0.0.1:55758)
0929 22:45:36.255612 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.255671 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:40887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:45:36.258666 16488 catalog_manager.cc:4584] TS 1463fd5e68bc49f89bb15acb4a15a5ae (127.12.27.129:40887): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f27e6c4d795408b9713c15a6eff0b10: Network error: Client connection negotiation failed: client connection to 127.12.27.129:40887: connect: Connection refused (error 111)
I20260929 22:45:36.258803 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16833
I20260929 22:45:36.258846 16973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.258742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:34849 (local address 127.0.0.1:41276)
0929 22:45:36.258792 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.258819 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.130:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:45:36.263125 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 16473
2026-09-29T22:45:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2010 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-29T22:45:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:36Z Disabled control of system clock
I20260929 22:45:36.290390 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39905
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:42381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:39905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:45:36.370467 17008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:36.370676 17008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:36.370697 17008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:36.371768 17008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:36.371803 17008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:36.371816 17008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:36.371829 17008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:36.371840 17008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:36.373118 17008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:42381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:39905
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:36.373315 17008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:36.373554 17008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:36.378422 17014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.378433 17016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.378656 17008 server_base.cc:1034] running on GCE node
W20260929 22:45:36.378432 17013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.378961 17008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:36.379259 17008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:36.380429 17008 hybrid_clock.cc:648] HybridClock initialized: now 1790721936380434 us; error 47 us; skew 500 ppm
I20260929 22:45:36.381662 17008 webserver.cc:460] Webserver started at http://127.12.27.190:34089/ using document root <none> and password file <none>
I20260929 22:45:36.381913 17008 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:36.381987 17008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:36.382157 17008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:36.383232 17008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "c8e4746aedd04000af179b688881882b"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "dc5e83a42a0b7e8582d078af0d3fcb4d"
server_key_iv: "9f7150f3d04946b029cbe43a02da7ba7"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.383597 17008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "c8e4746aedd04000af179b688881882b"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "dc5e83a42a0b7e8582d078af0d3fcb4d"
server_key_iv: "9f7150f3d04946b029cbe43a02da7ba7"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.384893 17008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:36.385591 17022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.385759 17008 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:36.385864 17008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "c8e4746aedd04000af179b688881882b"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "dc5e83a42a0b7e8582d078af0d3fcb4d"
server_key_iv: "9f7150f3d04946b029cbe43a02da7ba7"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.385938 17008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:36.389320 17008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:36.389588 17008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:36.389731 17008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:36.393630 17008 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:39905
I20260929 22:45:36.393658 17074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:39905 every 8 connection(s)
I20260929 22:45:36.393980 17008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:36.394348 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17008
I20260929 22:45:36.394480 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:36.394670 12398 external_mini_cluster.cc:1428] Setting key f674a98e002154afa8fa52852715e167
I20260929 22:45:36.394717 17075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.397555 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.395434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57480 (local address 127.12.27.190:39905)
0929 22:45:36.395623 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.395674 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.395707 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:45:36.396238 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.396246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.396287 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.396441 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.397141 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.397147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.397147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.397156 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.397194 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.397204 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.397281 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.397349 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.397404 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260929 22:45:36.397972 17075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b: Bootstrap starting.
I20260929 22:45:36.398597 17075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.398875 17075 log.cc:824] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.399500 17075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b: No bootstrap required, opened a new log
I20260929 22:45:36.400820 17075 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e4746aedd04000af179b688881882b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39905 } }
I20260929 22:45:36.400950 17075 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.400974 17075 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4746aedd04000af179b688881882b, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.401098 17075 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e4746aedd04000af179b688881882b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39905 } }
I20260929 22:45:36.401203 17075 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:36.401227 17075 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:36.401296 17075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:36.401790 17075 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e4746aedd04000af179b688881882b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39905 } }
I20260929 22:45:36.401901 17075 leader_election.cc:302] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8e4746aedd04000af179b688881882b; no voters:
I20260929 22:45:36.402081 17075 leader_election.cc:288] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:36.402349 17075 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:36.402359 17080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:36.402599 17080 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [term 1 LEADER]: Becoming Leader. State: Replica: c8e4746aedd04000af179b688881882b, State: Running, Role: LEADER
I20260929 22:45:36.402700 17080 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e4746aedd04000af179b688881882b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39905 } }
I20260929 22:45:36.403177 17081 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8e4746aedd04000af179b688881882b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e4746aedd04000af179b688881882b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39905 } } }
I20260929 22:45:36.403213 17082 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8e4746aedd04000af179b688881882b. Latest consensus state: current_term: 1 leader_uuid: "c8e4746aedd04000af179b688881882b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e4746aedd04000af179b688881882b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39905 } } }
I20260929 22:45:36.403265 17081 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:36.403290 17082 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:36.403445 17090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:36.404031 17090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:36.405436 17090 catalog_manager.cc:1347] Generated new cluster ID: 11d4d7cc51a8434b87226d00961ee82e
I20260929 22:45:36.405488 17090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:36.423928 17090 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:36.424150 17090 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:36.427881 17090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b: Generated new TSK 0
I20260929 22:45:36.428085 17090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:45:36.433076 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39905
--builtin_ntp_servers=127.12.27.148:42381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:45:36.513365 17099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:36.513597 17099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:36.513634 17099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:36.514776 17099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:36.514842 17099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:36.514886 17099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:36.516300 17099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:42381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:36.516564 17099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:36.516860 17099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:36.522708 17105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.522703 17104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.522912 17107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.522935 17099 server_base.cc:1034] running on GCE node
I20260929 22:45:36.523175 17099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:36.523427 17099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:36.524593 17099 hybrid_clock.cc:648] HybridClock initialized: now 1790721936524562 us; error 45 us; skew 500 ppm
I20260929 22:45:36.525837 17099 webserver.cc:460] Webserver started at http://127.12.27.129:46229/ using document root <none> and password file <none>
I20260929 22:45:36.526091 17099 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:36.526186 17099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:36.526324 17099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:36.527377 17099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "85371808d7b84f7fa2bff6097b734c76"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "b6d3a60260ec9a1bc92182e7ca22a5bc"
server_key_iv: "18e2560b355cb4b9d9938a74c80030ab"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.527776 17099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "85371808d7b84f7fa2bff6097b734c76"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "b6d3a60260ec9a1bc92182e7ca22a5bc"
server_key_iv: "18e2560b355cb4b9d9938a74c80030ab"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.529125 17099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:36.529855 17113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.530043 17099 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:36.530140 17099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "85371808d7b84f7fa2bff6097b734c76"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "b6d3a60260ec9a1bc92182e7ca22a5bc"
server_key_iv: "18e2560b355cb4b9d9938a74c80030ab"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.530222 17099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:36.533586 17099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:36.533843 17099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:36.533987 17099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:36.534192 17099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:36.534494 17099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:36.534549 17099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.534590 17099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:36.534615 17099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.540381 17099 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:45089
I20260929 22:45:36.540419 17226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:45089 every 8 connection(s)
I20260929 22:45:36.540788 17099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:45:36.543726 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.541546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:49903 (local address 127.12.27.190:39905)
0929 22:45:36.541614 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.541617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.541825 (+ 208us) server_negotiation.cc:407] Connection header received
0929 22:45:36.542260 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.542261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.542266 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.542318 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.543492 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.543493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.543493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.543496 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.543509 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.543513 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.543561 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.543609 (+ 48us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.543620 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:45:36.543941 17229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.541517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39905 (local address 127.12.27.129:49903)
0929 22:45:36.541711 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.541745 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.542176 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.542368 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.542371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.542378 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.543350 (+ 972us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:36.543351 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.543379 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:36.543406 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.543559 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.543562 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.543565 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.543615 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.543729 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":113,"threads_started":1}
I20260929 22:45:36.544433 17227 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39905
I20260929 22:45:36.544548 17227 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:36.544689 17227 heartbeater.cc:511] Master 127.12.27.190:39905 requested a full tablet report, sending...
I20260929 22:45:36.545179 17039 ts_manager.cc:194] Registered new tserver with Master: 85371808d7b84f7fa2bff6097b734c76 (127.12.27.129:45089)
I20260929 22:45:36.548146 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17099
I20260929 22:45:36.548230 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:36.548424 12398 external_mini_cluster.cc:1428] Setting key 9cf98c284ac6b031e30ba8cde0088f96
I20260929 22:45:36.549386 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39905
--builtin_ntp_servers=127.12.27.148:42381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:45:36.631989 17230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:36.632216 17230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:36.632254 17230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:36.633541 17230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:36.633597 17230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:36.633641 17230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:36.635007 17230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:42381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:36.635262 17230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:36.635555 17230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:36.640496 17236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.640544 17230 server_base.cc:1034] running on GCE node
W20260929 22:45:36.640549 17238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.640676 17235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.640882 17230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:36.641078 17230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:36.642210 17230 hybrid_clock.cc:648] HybridClock initialized: now 1790721936642198 us; error 28 us; skew 500 ppm
I20260929 22:45:36.643472 17230 webserver.cc:460] Webserver started at http://127.12.27.130:33093/ using document root <none> and password file <none>
I20260929 22:45:36.643740 17230 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:36.643788 17230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:36.643954 17230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:36.645025 17230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "dc26794b3fb24ea2b5f99c108ed5167a"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "4cd2401a3c15d163b72f9055b27f55ff"
server_key_iv: "0eff26a349e8e1f85068d348299dc537"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.645380 17230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "dc26794b3fb24ea2b5f99c108ed5167a"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "4cd2401a3c15d163b72f9055b27f55ff"
server_key_iv: "0eff26a349e8e1f85068d348299dc537"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.646631 17230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:36.647356 17244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.647539 17230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:36.647655 17230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "dc26794b3fb24ea2b5f99c108ed5167a"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "4cd2401a3c15d163b72f9055b27f55ff"
server_key_iv: "0eff26a349e8e1f85068d348299dc537"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.647724 17230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:36.650964 17230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:36.651221 17230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:36.651363 17230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:36.651559 17230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:36.651870 17230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:36.651925 17230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.651964 17230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:36.651997 17230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.657574 17230 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:35191
I20260929 22:45:36.657614 17358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:35191 every 8 connection(s)
I20260929 22:45:36.657903 17230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:45:36.660658 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.658569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:54577 (local address 127.12.27.190:39905)
0929 22:45:36.658610 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.658612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.658859 (+ 247us) server_negotiation.cc:407] Connection header received
0929 22:45:36.659309 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.659310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.659316 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.659375 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.660477 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.660478 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.660478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.660482 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.660495 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.660499 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.660541 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.660594 (+ 53us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.660605 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:45:36.660856 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.658549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39905 (local address 127.12.27.130:54577)
0929 22:45:36.658721 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.658762 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.659196 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.659421 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.659424 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.659432 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.660332 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:36.660332 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.660359 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:36.660385 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.660547 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.660549 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.660552 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.660601 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.660644 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260929 22:45:36.661342 17359 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39905
I20260929 22:45:36.661417 17359 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:36.661527 17359 heartbeater.cc:511] Master 127.12.27.190:39905 requested a full tablet report, sending...
I20260929 22:45:36.661844 17039 ts_manager.cc:194] Registered new tserver with Master: dc26794b3fb24ea2b5f99c108ed5167a (127.12.27.130:35191)
I20260929 22:45:36.663856 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17230
I20260929 22:45:36.663949 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:36.664083 12398 external_mini_cluster.cc:1428] Setting key 66f86a30163ffb499d05ba7f98557fd5
I20260929 22:45:36.664889 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39905
--builtin_ntp_servers=127.12.27.148:42381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 22:45:36.744014 17362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:36.744210 17362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:36.744232 17362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:36.745319 17362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:36.745355 17362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:36.745380 17362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:36.746626 17362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:42381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:36.746810 17362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:36.747045 17362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:36.752074 17368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.752187 17370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:36.752369 17367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:36.752619 17362 server_base.cc:1034] running on GCE node
I20260929 22:45:36.752888 17362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:36.753153 17362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:36.754319 17362 hybrid_clock.cc:648] HybridClock initialized: now 1790721936754305 us; error 42 us; skew 500 ppm
I20260929 22:45:36.755517 17362 webserver.cc:460] Webserver started at http://127.12.27.131:36091/ using document root <none> and password file <none>
I20260929 22:45:36.755800 17362 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:36.755872 17362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:36.756009 17362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:36.757077 17362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "3f33b41d59f9427ba3e3449d82010454"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "4fc7582457669460b5ffc9548b2d0526"
server_key_iv: "46203919c69a16284ed0dd4ee7a91102"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.757457 17362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "3f33b41d59f9427ba3e3449d82010454"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "4fc7582457669460b5ffc9548b2d0526"
server_key_iv: "46203919c69a16284ed0dd4ee7a91102"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.758751 17362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:36.759516 17376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.759857 17362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:36.759960 17362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "3f33b41d59f9427ba3e3449d82010454"
format_stamp: "Formatted at 2026-09-29 22:45:36 on dist-test-slave-00d6"
server_key: "4fc7582457669460b5ffc9548b2d0526"
server_key_iv: "46203919c69a16284ed0dd4ee7a91102"
server_key_version: "encryptionkey@0"
I20260929 22:45:36.760049 17362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:36.763288 17362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:36.763624 17362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:36.763790 17362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:36.764020 17362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:36.764324 17362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:36.764379 17362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.764426 17362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:36.764454 17362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:36.770205 17362 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38237
I20260929 22:45:36.770251 17489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38237 every 8 connection(s)
I20260929 22:45:36.770560 17362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:36.773511 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.771232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:33079 (local address 127.12.27.190:39905)
0929 22:45:36.771273 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.771275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.771509 (+ 234us) server_negotiation.cc:407] Connection header received
0929 22:45:36.772050 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.772051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.772057 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.772120 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.773281 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.773282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.773283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.773286 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.773299 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.773303 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.773351 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.773436 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.773457 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:45:36.773692 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.771195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39905 (local address 127.12.27.131:33079)
0929 22:45:36.771370 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.771411 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.771954 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.772191 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.772195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.772203 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.773135 (+ 932us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:36.773136 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.773164 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:36.773192 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.773365 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.773369 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.773371 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.773437 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.773484 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260929 22:45:36.774163 17490 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39905
I20260929 22:45:36.774235 17490 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:36.774336 17490 heartbeater.cc:511] Master 127.12.27.190:39905 requested a full tablet report, sending...
I20260929 22:45:36.774644 17039 ts_manager.cc:194] Registered new tserver with Master: 3f33b41d59f9427ba3e3449d82010454 (127.12.27.131:38237)
I20260929 22:45:36.779155 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17362
I20260929 22:45:36.779237 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:36.779420 12398 external_mini_cluster.cc:1428] Setting key 65ed720e7d4cbe4a9fd5e37ea1072f0c
I20260929 22:45:36.780336 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:45:36.783059 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.781615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57488 (local address 127.12.27.190:39905)
0929 22:45:36.781652 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.781654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.781820 (+ 166us) server_negotiation.cc:407] Connection header received
0929 22:45:36.781899 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.781900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.781905 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.781982 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.782669 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.782671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.782671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.782682 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.782716 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.782723 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.782817 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.782954 (+ 137us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.782971 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:45:36.785203 17039 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:36.786933 17039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:36.791168 17501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.789154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.12.27.131:38237)
0929 22:45:36.789923 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.789928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.789937 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:36.789964 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.789966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.789975 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.790330 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.790814 (+ 484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.790821 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.790822 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.790827 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.790862 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.790888 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.790947 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.791062 (+ 115us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.791079 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":72,"threads_started":1}
I20260929 22:45:36.791224 17502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.789352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57082 (local address 127.12.27.130:35191)
0929 22:45:36.789531 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.789536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.789660 (+ 124us) server_negotiation.cc:407] Connection header received
0929 22:45:36.789731 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.789734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.789746 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.789826 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.790832 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.790838 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.790839 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.790843 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.790885 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.790902 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.790984 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.791115 (+ 131us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.791132 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":78,"threads_started":1}
I20260929 22:45:36.791154 17499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.789081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38237 (local address 127.0.0.1:46136)
0929 22:45:36.789371 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.789412 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.789494 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.790090 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.790097 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.790104 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.790684 (+ 580us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:36.790685 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.790704 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:36.790731 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.790966 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.790971 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.790975 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.791050 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.791066 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":70,"threads_started":1}
I20260929 22:45:36.791385 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.789087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45089 (local address 127.0.0.1:56604)
0929 22:45:36.789741 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.789751 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.789797 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.790260 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.790261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.790263 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.791016 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:36.791016 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.791023 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:36.791035 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.791259 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.791260 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.791260 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.791315 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.791326 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":98,"threads_started":1}
I20260929 22:45:36.791733 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.789352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.12.27.129:45089)
0929 22:45:36.789586 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:36.789591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:36.789811 (+ 220us) server_negotiation.cc:407] Connection header received
0929 22:45:36.789869 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:36.789871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:36.789882 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:36.789962 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:36.791114 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:36.791122 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:36.791122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:36.791127 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:36.791157 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:36.791181 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:36.791233 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:36.791571 (+ 338us) server_negotiation.cc:299] Negotiation successful
0929 22:45:36.791590 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260929 22:45:36.791939 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:36.789086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:35191 (local address 127.0.0.1:57082)
0929 22:45:36.789584 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:36.789593 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:36.789660 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:36.790190 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:36.790191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:36.790194 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:36.790712 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:36.790713 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:36.790717 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:36.790731 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:36.790998 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:36.790999 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:36.791000 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:45:36.791055 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:45:36.791069 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":96,"threads_started":1}
I20260929 22:45:36.792214 17424 tablet_service.cc:1467] Processing CreateTablet for tablet adde53caa4a448efa5b58cfbbfdc2ab8 (DEFAULT_TABLE table=test-table [id=26526cecace14b80869e8a3d9d27bd54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:36.792313 17161 tablet_service.cc:1467] Processing CreateTablet for tablet adde53caa4a448efa5b58cfbbfdc2ab8 (DEFAULT_TABLE table=test-table [id=26526cecace14b80869e8a3d9d27bd54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:36.792572 17424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adde53caa4a448efa5b58cfbbfdc2ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.792618 17161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adde53caa4a448efa5b58cfbbfdc2ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.792814 17293 tablet_service.cc:1467] Processing CreateTablet for tablet adde53caa4a448efa5b58cfbbfdc2ab8 (DEFAULT_TABLE table=test-table [id=26526cecace14b80869e8a3d9d27bd54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:36.793164 17293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adde53caa4a448efa5b58cfbbfdc2ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:36.795718 17504 tablet_bootstrap.cc:492] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Bootstrap starting.
I20260929 22:45:36.796125 17506 tablet_bootstrap.cc:492] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Bootstrap starting.
I20260929 22:45:36.796463 17504 tablet_bootstrap.cc:654] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.796705 17506 tablet_bootstrap.cc:654] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.796797 17504 log.cc:824] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.797026 17506 log.cc:824] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.797333 17505 tablet_bootstrap.cc:492] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: Bootstrap starting.
I20260929 22:45:36.797679 17504 tablet_bootstrap.cc:492] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: No bootstrap required, opened a new log
I20260929 22:45:36.797752 17504 ts_tablet_manager.cc:1397] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:36.797752 17506 tablet_bootstrap.cc:492] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: No bootstrap required, opened a new log
I20260929 22:45:36.797817 17506 ts_tablet_manager.cc:1397] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:36.797966 17505 tablet_bootstrap.cc:654] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:36.798341 17505 log.cc:824] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:36.799099 17505 tablet_bootstrap.cc:492] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: No bootstrap required, opened a new log
I20260929 22:45:36.799170 17505 ts_tablet_manager.cc:1397] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:36.800333 17506 raft_consensus.cc:348] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:36.800510 17506 raft_consensus.cc:374] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.800559 17506 raft_consensus.cc:729] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f33b41d59f9427ba3e3449d82010454, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.800459 17504 raft_consensus.cc:348] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:36.800611 17504 raft_consensus.cc:374] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.800653 17504 raft_consensus.cc:729] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc26794b3fb24ea2b5f99c108ed5167a, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.800683 17506 consensus_queue.cc:260] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:36.800770 17504 consensus_queue.cc:260] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:36.801010 17490 heartbeater.cc:503] Master 127.12.27.190:39905 was elected leader, sending a full tablet report...
I20260929 22:45:36.801020 17504 ts_tablet_manager.cc:1428] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260929 22:45:36.801129 17359 heartbeater.cc:503] Master 127.12.27.190:39905 was elected leader, sending a full tablet report...
I20260929 22:45:36.801270 17506 ts_tablet_manager.cc:1428] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:36.802145 17505 raft_consensus.cc:348] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:36.802256 17505 raft_consensus.cc:374] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:36.802276 17505 raft_consensus.cc:729] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85371808d7b84f7fa2bff6097b734c76, State: Initialized, Role: FOLLOWER
I20260929 22:45:36.802374 17505 consensus_queue.cc:260] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:36.802634 17505 ts_tablet_manager.cc:1428] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:45:36.802721 17227 heartbeater.cc:503] Master 127.12.27.190:39905 was elected leader, sending a full tablet report...
W20260929 22:45:36.908397 17360 tablet.cc:2369] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:45:37.021080 17491 tablet.cc:2369] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:45:37.041486 17228 tablet.cc:2369] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:45:37.079573 17510 raft_consensus.cc:482] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:37.079715 17510 raft_consensus.cc:504] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:37.080052 17510 leader_election.cc:288] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc26794b3fb24ea2b5f99c108ed5167a (127.12.27.130:35191), 85371808d7b84f7fa2bff6097b734c76 (127.12.27.129:45089)
I20260929 22:45:37.081457 17502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.080464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:33839 (local address 127.12.27.130:35191)
0929 22:45:37.080530 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.080533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.080541 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:37.080598 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.080599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.080603 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.080646 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.081240 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.081242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.081242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.081246 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.081262 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.081266 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.081316 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.081365 (+ 49us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.081379 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:45:37.081457 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.080331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:51915 (local address 127.12.27.129:45089)
0929 22:45:37.080381 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.080383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.080406 (+ 23us) server_negotiation.cc:407] Connection header received
0929 22:45:37.080437 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.080437 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.080443 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.080514 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.081197 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.081199 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.081199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.081204 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.081219 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.081224 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.081302 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.081370 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.081384 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:45:37.081477 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.080265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45089 (local address 127.12.27.131:51915)
0929 22:45:37.080318 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.080331 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:37.080374 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:37.080533 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:37.080533 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:37.080536 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:37.081062 (+ 526us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:37.081063 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:37.081069 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:37.081099 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:37.081302 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:37.081303 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:37.081303 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 22:45:37.081361 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:45:37.081376 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 22:45:37.081506 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.080268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:35191 (local address 127.12.27.131:33839)
0929 22:45:37.080462 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.080477 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:37.080535 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:37.080670 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:37.080671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:37.080673 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:37.081160 (+ 487us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:45:37.081161 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:37.081167 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:45:37.081177 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:37.081311 (+ 134us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:37.081312 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:37.081312 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 22:45:37.081364 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:45:37.081378 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":22,"thread_start_us":104,"threads_started":1}
I20260929 22:45:37.081925 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adde53caa4a448efa5b58cfbbfdc2ab8" candidate_uuid: "3f33b41d59f9427ba3e3449d82010454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" is_pre_election: true
I20260929 22:45:37.081990 17181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adde53caa4a448efa5b58cfbbfdc2ab8" candidate_uuid: "3f33b41d59f9427ba3e3449d82010454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85371808d7b84f7fa2bff6097b734c76" is_pre_election: true
I20260929 22:45:37.082110 17313 raft_consensus.cc:2454] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f33b41d59f9427ba3e3449d82010454 in term 0.
I20260929 22:45:37.082151 17181 raft_consensus.cc:2454] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f33b41d59f9427ba3e3449d82010454 in term 0.
I20260929 22:45:37.082334 17377 leader_election.cc:302] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f33b41d59f9427ba3e3449d82010454, dc26794b3fb24ea2b5f99c108ed5167a; no voters:
I20260929 22:45:37.082475 17510 raft_consensus.cc:2781] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:37.082561 17510 raft_consensus.cc:482] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:37.082595 17510 raft_consensus.cc:3037] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.083338 17510 raft_consensus.cc:504] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:37.083479 17510 leader_election.cc:288] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [CANDIDATE]: Term 1 election: Requested vote from peers dc26794b3fb24ea2b5f99c108ed5167a (127.12.27.130:35191), 85371808d7b84f7fa2bff6097b734c76 (127.12.27.129:45089)
I20260929 22:45:37.083654 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adde53caa4a448efa5b58cfbbfdc2ab8" candidate_uuid: "3f33b41d59f9427ba3e3449d82010454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc26794b3fb24ea2b5f99c108ed5167a"
I20260929 22:45:37.083670 17181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adde53caa4a448efa5b58cfbbfdc2ab8" candidate_uuid: "3f33b41d59f9427ba3e3449d82010454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85371808d7b84f7fa2bff6097b734c76"
I20260929 22:45:37.083756 17313 raft_consensus.cc:3037] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.083751 17181 raft_consensus.cc:3037] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.084478 17313 raft_consensus.cc:2454] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f33b41d59f9427ba3e3449d82010454 in term 1.
I20260929 22:45:37.084484 17181 raft_consensus.cc:2454] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f33b41d59f9427ba3e3449d82010454 in term 1.
I20260929 22:45:37.084645 17377 leader_election.cc:302] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f33b41d59f9427ba3e3449d82010454, dc26794b3fb24ea2b5f99c108ed5167a; no voters:
I20260929 22:45:37.084765 17510 raft_consensus.cc:2781] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:37.084895 17510 raft_consensus.cc:686] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 1 LEADER]: Becoming Leader. State: Replica: 3f33b41d59f9427ba3e3449d82010454, State: Running, Role: LEADER
I20260929 22:45:37.084992 17510 consensus_queue.cc:237] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } }
I20260929 22:45:37.085780 17038 catalog_manager.cc:5495] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f33b41d59f9427ba3e3449d82010454 (127.12.27.131). New cstate: current_term: 1 leader_uuid: "3f33b41d59f9427ba3e3449d82010454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f33b41d59f9427ba3e3449d82010454" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:37.148082 17501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.147085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.12.27.131:38237)
0929 22:45:37.147147 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.147149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.147159 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:37.147195 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.147196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.147208 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.147259 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.147854 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.147855 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.147855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.147859 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.147874 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.147877 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.147925 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.147968 (+ 43us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.147979 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:45:37.149874 17313 raft_consensus.cc:1261] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 1 FOLLOWER]: Refusing update from remote peer 3f33b41d59f9427ba3e3449d82010454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:37.149875 17181 raft_consensus.cc:1261] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 1 FOLLOWER]: Refusing update from remote peer 3f33b41d59f9427ba3e3449d82010454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:37.150282 17514 consensus_queue.cc:1035] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc26794b3fb24ea2b5f99c108ed5167a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:37.150444 17510 consensus_queue.cc:1035] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85371808d7b84f7fa2bff6097b734c76" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:37.152572 17517 mvcc.cc:205] Tried to move back new op lower bound from 7334797054562918400 to 7334797054300602368. Current Snapshot: MvccSnapshot[applied={T|T < 7334797054562918400}]
I20260929 22:45:37.153168 17519 mvcc.cc:205] Tried to move back new op lower bound from 7334797054562918400 to 7334797054300602368. Current Snapshot: MvccSnapshot[applied={T|T < 7334797054562918400}]
I20260929 22:45:37.155435 17037 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:37.155529 17037 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:37.156284 17037 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8e4746aedd04000af179b688881882b: Sending DeleteTablet for 3 replicas of tablet adde53caa4a448efa5b58cfbbfdc2ab8
I20260929 22:45:37.156592 17424 tablet_service.cc:1514] Processing DeleteTablet for tablet adde53caa4a448efa5b58cfbbfdc2ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:37 UTC) from {username='slave'} at 127.0.0.1:46136
I20260929 22:45:37.156704 17293 tablet_service.cc:1514] Processing DeleteTablet for tablet adde53caa4a448efa5b58cfbbfdc2ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:37 UTC) from {username='slave'} at 127.0.0.1:57082
I20260929 22:45:37.156814 17526 tablet_replica.cc:330] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: stopping tablet replica
I20260929 22:45:37.156905 17526 raft_consensus.cc:2229] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:37.156945 17161 tablet_service.cc:1514] Processing DeleteTablet for tablet adde53caa4a448efa5b58cfbbfdc2ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:37 UTC) from {username='slave'} at 127.0.0.1:56604
I20260929 22:45:37.157050 17526 raft_consensus.cc:2258] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:37.157256 17528 tablet_replica.cc:330] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76: stopping tablet replica
I20260929 22:45:37.157281 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17099
I20260929 22:45:37.157223 17527 tablet_replica.cc:330] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: stopping tablet replica
I20260929 22:45:37.157373 17527 raft_consensus.cc:2229] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:37.157457 17528 raft_consensus.cc:2229] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:37.157485 17527 raft_consensus.cc:2258] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:37.157606 17528 raft_consensus.cc:2258] T adde53caa4a448efa5b58cfbbfdc2ab8 P 85371808d7b84f7fa2bff6097b734c76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:37.158671 17527 ts_tablet_manager.cc:1905] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:37.160768 17527 ts_tablet_manager.cc:1918] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:37.160846 17527 log.cc:1196] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/adde53caa4a448efa5b58cfbbfdc2ab8
I20260929 22:45:37.161111 17527 ts_tablet_manager.cc:1939] T adde53caa4a448efa5b58cfbbfdc2ab8 P dc26794b3fb24ea2b5f99c108ed5167a: Deleting consensus metadata
I20260929 22:45:37.161517 17023 catalog_manager.cc:4841] TS dc26794b3fb24ea2b5f99c108ed5167a (127.12.27.130:35191): tablet adde53caa4a448efa5b58cfbbfdc2ab8 (table test-table [id=26526cecace14b80869e8a3d9d27bd54]) successfully deleted
W20260929 22:45:37.164136 17025 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:45089 (error 108)
I20260929 22:45:37.164383 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17230
I20260929 22:45:37.165122 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.165010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45089 (local address 127.0.0.1:56606)
0929 22:45:37.165054 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.165088 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:45089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260929 22:45:37.165228 17025 catalog_manager.cc:4584] TS 85371808d7b84f7fa2bff6097b734c76 (127.12.27.129:45089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet adde53caa4a448efa5b58cfbbfdc2ab8: Network error: Client connection negotiation failed: client connection to 127.12.27.129:45089: connect: Connection refused (error 111)
I20260929 22:45:37.169210 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17362
I20260929 22:45:37.169212 17526 ts_tablet_manager.cc:1905] T adde53caa4a448efa5b58cfbbfdc2ab8 P 3f33b41d59f9427ba3e3449d82010454: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:37.173080 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17008
I20260929 22:45:37.173115 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.172993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38237 (local address 127.0.0.1:46158)
0929 22:45:37.173050 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.173082 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.131:38237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
2026-09-29T22:45:37Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (908 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260929 22:45:37.192366 12398 mini_oidc.cc:152] Starting JWKS server
I20260929 22:45:37.193372 12398 webserver.cc:460] Webserver started at https://127.0.0.1:39325/ using document root <none> and password file <none>
I20260929 22:45:37.193454 12398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 22:45:37.193584 12398 webserver.cc:460] Webserver started at http://127.0.0.1:41725/ using document root <none> and password file <none>
2026-09-29T22:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:37Z Disabled control of system clock
I20260929 22:45:37.201021 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:38267
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:41711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:38267
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39325/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/testchainca.cert with env {}
W20260929 22:45:37.280117 17535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:37.280328 17535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:37.280350 17535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:37.281473 17535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:37.281509 17535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:37.281522 17535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:37.281535 17535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:37.281548 17535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:45:37.281560 17535 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:45:37.281571 17535 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39325/jwks.json
I20260929 22:45:37.283070 17535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:38267
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:38267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39325/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:37.283308 17535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:37.283483 17535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:37.288394 17540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:37.288367 17541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:37.288576 17535 server_base.cc:1034] running on GCE node
W20260929 22:45:37.288380 17543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:37.288897 17535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:37.289198 17535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:37.290364 17535 hybrid_clock.cc:648] HybridClock initialized: now 1790721937290350 us; error 44 us; skew 500 ppm
I20260929 22:45:37.291761 17535 webserver.cc:460] Webserver started at http://127.12.27.190:33215/ using document root <none> and password file <none>
I20260929 22:45:37.292007 17535 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:37.292078 17535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:37.292224 17535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:37.293345 17535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "50f6b3d6c36b42f88a8340fe7e010ce3"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "ec19fb3227bff38c198795dc4483acf1"
server_key_iv: "4b66e41d21454a4152b94ff7adabc325"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.293697 17535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "50f6b3d6c36b42f88a8340fe7e010ce3"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "ec19fb3227bff38c198795dc4483acf1"
server_key_iv: "4b66e41d21454a4152b94ff7adabc325"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.295149 17535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:37.295974 17549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:37.296140 17535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:37.296245 17535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "50f6b3d6c36b42f88a8340fe7e010ce3"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "ec19fb3227bff38c198795dc4483acf1"
server_key_iv: "4b66e41d21454a4152b94ff7adabc325"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.296319 17535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:37.314615 17535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:37.315004 17535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:37.315158 17535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:37.319036 17535 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:38267
I20260929 22:45:37.319083 17601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:38267 every 8 connection(s)
I20260929 22:45:37.319442 17535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:37.320451 17602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:37.322674 17602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3: Bootstrap starting.
I20260929 22:45:37.323263 17602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:37.323559 17602 log.cc:824] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:37.324235 17602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3: No bootstrap required, opened a new log
I20260929 22:45:37.325187 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17535
I20260929 22:45:37.325402 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:37.325588 12398 external_mini_cluster.cc:1428] Setting key c633d1180d95d9a633adbff66ea986db
I20260929 22:45:37.326098 17602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38267 } }
I20260929 22:45:37.326308 17602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:37.326360 17602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f6b3d6c36b42f88a8340fe7e010ce3, State: Initialized, Role: FOLLOWER
I20260929 22:45:37.326495 17602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38267 } }
I20260929 22:45:37.326574 17602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:37.326603 17602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:37.326649 17602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.327678 17602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38267 } }
I20260929 22:45:37.327785 17602 leader_election.cc:302] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50f6b3d6c36b42f88a8340fe7e010ce3; no voters:
I20260929 22:45:37.327929 17602 leader_election.cc:288] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:37.328006 17607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:37.328143 17607 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f6b3d6c36b42f88a8340fe7e010ce3, State: Running, Role: LEADER
I20260929 22:45:37.328158 17602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:37.328235 17607 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38267 } }
I20260929 22:45:37.328590 17609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50f6b3d6c36b42f88a8340fe7e010ce3. Latest consensus state: current_term: 1 leader_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38267 } } }
I20260929 22:45:37.328692 17609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.328888 17615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:37.329411 17615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:37.329834 17608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f6b3d6c36b42f88a8340fe7e010ce3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 38267 } } }
I20260929 22:45:37.329911 17608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.331193 17615 catalog_manager.cc:1347] Generated new cluster ID: 219904dec9714dd69d978df3d8cbe04a
I20260929 22:45:37.331243 17615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:37.331725 17606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.326125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.12.27.190:38267)
0929 22:45:37.326353 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.326363 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.326397 (+ 34us) server_negotiation.cc:407] Connection header received
0929 22:45:37.326518 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.326525 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.326597 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.326736 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.326953 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.328394 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.329520 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.330153 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.330276 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.330962 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.330967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.330967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.331174 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.331214 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.331229 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.331294 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.331413 (+ 119us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.331488 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260929 22:45:37.332567 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:45:37.344204 17615 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:37.344889 17615 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:37.353068 17615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50f6b3d6c36b42f88a8340fe7e010ce3: Generated new TSK 0
I20260929 22:45:37.353276 17615 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 22:45:37.382756 17632 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260929 22:45:37.382856 17632 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260929 22:45:37.383342 17631 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:37.359778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:38267 (local address 127.0.0.1:52222)
0929 22:45:37.359983 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.359995 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:37.360067 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:37.360237 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:37.360237 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:37.360239 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:45:37.360301 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:37.360303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.360907 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.360908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:37.361853 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:37.361856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.362483 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.362484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:37.362570 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.362591 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:45:37.382977 (+ 20386us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 22:45:37.383093 (+ 116us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.27.190:38267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":112,"threads_started":1}
I20260929 22:45:37.383700 17606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.359831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.12.27.190:38267)
0929 22:45:37.359896 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.359898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.360058 (+ 160us) server_negotiation.cc:407] Connection header received
0929 22:45:37.360161 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.360161 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.360172 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.360224 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:45:37.360370 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.360834 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.362013 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.362370 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.362461 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.362692 (+ 231us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:45:37.382767 (+ 20075us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 22:45:37.383600 (+ 833us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52222: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":40}
W20260929 22:45:37.383751 17606 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52222: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.27.190:38267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260929 22:45:37.384087 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17535
2026-09-29T22:45:37Z chronyd exiting
I20260929 22:45:37.419785 12398 test_util.cc:175] -----------------------------------------------
I20260929 22:45:37.419860 12398 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790721915685765-12398-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (228 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260929 22:45:37.420607 12398 mini_oidc.cc:152] Starting JWKS server
I20260929 22:45:37.421294 12398 webserver.cc:460] Webserver started at https://127.0.0.1:33501/ using document root <none> and password file <none>
I20260929 22:45:37.421335 12398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 22:45:37.421515 12398 webserver.cc:460] Webserver started at http://127.0.0.1:44063/ using document root <none> and password file <none>
2026-09-29T22:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:37Z Disabled control of system clock
I20260929 22:45:37.428867 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:35301
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:42881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:35301
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33501/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/testchainca.cert with env {}
W20260929 22:45:37.506434 17638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:37.506634 17638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:37.506655 17638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:37.507735 17638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:37.507769 17638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:37.507782 17638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:37.507794 17638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:37.507807 17638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:45:37.507819 17638 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:45:37.507830 17638 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33501/jwks.json
I20260929 22:45:37.509234 17638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:42881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:35301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:35301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33501/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:37.509419 17638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:37.509583 17638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:37.514418 17644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:37.514429 17646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:37.514441 17643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:37.514571 17638 server_base.cc:1034] running on GCE node
I20260929 22:45:37.515005 17638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:37.515288 17638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:37.516446 17638 hybrid_clock.cc:648] HybridClock initialized: now 1790721937516442 us; error 35 us; skew 500 ppm
I20260929 22:45:37.517791 17638 webserver.cc:460] Webserver started at http://127.12.27.190:33243/ using document root <none> and password file <none>
I20260929 22:45:37.518074 17638 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:37.518148 17638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:37.518298 17638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:37.519322 17638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "871b12f3038e41debbf4fb328a954753"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "7fda3105f5c503ad21fa24d9ab5d4505"
server_key_iv: "150d9c1fe08f240e5f01af2fc0676781"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.519737 17638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "871b12f3038e41debbf4fb328a954753"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "7fda3105f5c503ad21fa24d9ab5d4505"
server_key_iv: "150d9c1fe08f240e5f01af2fc0676781"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.521049 17638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:37.521735 17652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:37.521900 17638 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:37.522006 17638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "871b12f3038e41debbf4fb328a954753"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "7fda3105f5c503ad21fa24d9ab5d4505"
server_key_iv: "150d9c1fe08f240e5f01af2fc0676781"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.522085 17638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:37.549539 17638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:37.549831 17638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:37.549962 17638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:37.553906 17638 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:35301
I20260929 22:45:37.553938 17705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:35301 every 8 connection(s)
I20260929 22:45:37.554314 17638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:37.554973 17706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:37.557749 17706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753: Bootstrap starting.
I20260929 22:45:37.558357 17706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:37.558650 17706 log.cc:824] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:37.559316 17706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753: No bootstrap required, opened a new log
I20260929 22:45:37.560904 17706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12f3038e41debbf4fb328a954753" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35301 } }
I20260929 22:45:37.561062 17706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:37.561085 17706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 871b12f3038e41debbf4fb328a954753, State: Initialized, Role: FOLLOWER
I20260929 22:45:37.561280 17706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12f3038e41debbf4fb328a954753" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35301 } }
I20260929 22:45:37.561360 17706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:37.561401 17706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:37.561451 17706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.561973 17706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12f3038e41debbf4fb328a954753" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35301 } }
I20260929 22:45:37.562079 17706 leader_election.cc:302] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 871b12f3038e41debbf4fb328a954753; no voters:
I20260929 22:45:37.562258 17706 leader_election.cc:288] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:37.562294 17709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:37.562472 17709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [term 1 LEADER]: Becoming Leader. State: Replica: 871b12f3038e41debbf4fb328a954753, State: Running, Role: LEADER
I20260929 22:45:37.562513 17706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:37.562580 17709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12f3038e41debbf4fb328a954753" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35301 } }
I20260929 22:45:37.562913 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17638
I20260929 22:45:37.563011 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:37.563020 17710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "871b12f3038e41debbf4fb328a954753" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12f3038e41debbf4fb328a954753" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35301 } } }
I20260929 22:45:37.563097 17710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.563205 17711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 871b12f3038e41debbf4fb328a954753. Latest consensus state: current_term: 1 leader_uuid: "871b12f3038e41debbf4fb328a954753" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12f3038e41debbf4fb328a954753" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35301 } } }
I20260929 22:45:37.563233 12398 external_mini_cluster.cc:1428] Setting key 55f01b2fdfef29870bd00ef381776f2f
I20260929 22:45:37.563259 17711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.563308 17717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:37.563814 17717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:37.565482 17717 catalog_manager.cc:1347] Generated new cluster ID: dc4da860b24f4cb6986adb003d4094ff
I20260929 22:45:37.565537 17717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:37.569950 17726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.563807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35434 (local address 127.12.27.190:35301)
0929 22:45:37.564035 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.564043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.564271 (+ 228us) server_negotiation.cc:407] Connection header received
0929 22:45:37.564467 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.564475 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.564542 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.564682 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.565054 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.566355 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.567505 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.568162 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.568260 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.569200 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.569203 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.569204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.569414 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.569470 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.569485 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.569525 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.569660 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.569742 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":62,"threads_started":1}
I20260929 22:45:37.570894 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:45:37.578183 17717 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:37.578688 17717 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:37.581382 17717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 871b12f3038e41debbf4fb328a954753: Generated new TSK 0
I20260929 22:45:37.581566 17717 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 22:45:37.601389 17736 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260929 22:45:37.601475 17736 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260929 22:45:37.601791 17726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.587253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35436 (local address 127.12.27.190:35301)
0929 22:45:37.587298 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.587300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.587396 (+ 96us) server_negotiation.cc:407] Connection header received
0929 22:45:37.587452 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.587453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.587465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.587541 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:45:37.587675 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.588842 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.589609 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.589933 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.590005 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.590141 (+ 136us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:45:37.601579 (+ 11438us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 22:45:37.601720 (+ 141us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35436: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 22:45:37.601850 17726 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35436: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260929 22:45:37.601835 17735 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:37.587153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:35301 (local address 127.0.0.1:35436)
0929 22:45:37.587324 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.587334 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:37.587393 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:37.587544 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:37.587545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:37.587546 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:45:37.587588 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:37.587590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.588936 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.588937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:37.589529 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:37.589530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.590011 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.590012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:37.590050 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.590054 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:45:37.601682 (+ 11628us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 22:45:37.601766 (+ 84us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.27.190:35301: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33501/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260929 22:45:37.602118 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17638
2026-09-29T22:45:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (220 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260929 22:45:37.641285 12398 mini_oidc.cc:152] Starting JWKS server
I20260929 22:45:37.641985 12398 webserver.cc:460] Webserver started at https://127.0.0.1:40043/ using document root <none> and password file <none>
I20260929 22:45:37.642026 12398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 22:45:37.642215 12398 webserver.cc:460] Webserver started at http://127.0.0.1:44365/ using document root <none> and password file <none>
2026-09-29T22:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:37Z Disabled control of system clock
I20260929 22:45:37.649677 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40613
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:40613
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40043/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 22:45:37.729476 17742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:37.729739 17742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:37.729785 17742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:37.730967 17742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:37.731043 17742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:37.731065 17742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:37.731086 17742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:37.731115 17742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:45:37.731139 17742 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:45:37.731160 17742 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40043/jwks.json
I20260929 22:45:37.732555 17742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:40613
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40043/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:37.732861 17742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:37.733157 17742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:37.738260 17747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:37.738294 17750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:37.738441 17742 server_base.cc:1034] running on GCE node
W20260929 22:45:37.738526 17748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:37.738778 17742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:37.739125 17742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:37.740276 17742 hybrid_clock.cc:648] HybridClock initialized: now 1790721937740259 us; error 38 us; skew 500 ppm
I20260929 22:45:37.741554 17742 webserver.cc:460] Webserver started at http://127.12.27.190:42737/ using document root <none> and password file <none>
I20260929 22:45:37.741784 17742 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:37.741828 17742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:37.741997 17742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:37.743052 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "b794f66b94174d6095f672981e934f11"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "7e8b794ef23b814174f4af9543918c43"
server_key_iv: "8375d09e443e0437d5e4aee4cdfaa7db"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.743405 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "b794f66b94174d6095f672981e934f11"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "7e8b794ef23b814174f4af9543918c43"
server_key_iv: "8375d09e443e0437d5e4aee4cdfaa7db"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.744757 17742 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:37.745434 17756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:37.745672 17742 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:37.745750 17742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "b794f66b94174d6095f672981e934f11"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "7e8b794ef23b814174f4af9543918c43"
server_key_iv: "8375d09e443e0437d5e4aee4cdfaa7db"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.745807 17742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:37.755517 17742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:37.755816 17742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:37.755921 17742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:37.759805 17742 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:40613
I20260929 22:45:37.759835 17808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:40613 every 8 connection(s)
I20260929 22:45:37.760164 17742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:37.760768 17809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:37.763360 17809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11: Bootstrap starting.
I20260929 22:45:37.763821 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17742
I20260929 22:45:37.763936 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:37.764052 17809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:37.764101 12398 external_mini_cluster.cc:1428] Setting key 54a15364d811ab6b5ede85bf69bba669
I20260929 22:45:37.764335 17809 log.cc:824] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:37.765121 17809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11: No bootstrap required, opened a new log
I20260929 22:45:37.767359 17809 raft_consensus.cc:348] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b794f66b94174d6095f672981e934f11" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40613 } }
I20260929 22:45:37.767525 17809 raft_consensus.cc:374] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:37.767557 17809 raft_consensus.cc:729] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b794f66b94174d6095f672981e934f11, State: Initialized, Role: FOLLOWER
I20260929 22:45:37.767730 17809 consensus_queue.cc:260] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b794f66b94174d6095f672981e934f11" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40613 } }
I20260929 22:45:37.767804 17809 raft_consensus.cc:388] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:37.767833 17809 raft_consensus.cc:482] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:37.767882 17809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.768499 17809 raft_consensus.cc:504] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b794f66b94174d6095f672981e934f11" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40613 } }
I20260929 22:45:37.768606 17809 leader_election.cc:302] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b794f66b94174d6095f672981e934f11; no voters:
I20260929 22:45:37.768793 17809 leader_election.cc:288] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:37.768855 17814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:37.768971 17814 raft_consensus.cc:686] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [term 1 LEADER]: Becoming Leader. State: Replica: b794f66b94174d6095f672981e934f11, State: Running, Role: LEADER
I20260929 22:45:37.769062 17809 sys_catalog.cc:564] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:37.769050 17814 consensus_queue.cc:237] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b794f66b94174d6095f672981e934f11" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40613 } }
I20260929 22:45:37.769382 17814 sys_catalog.cc:455] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b794f66b94174d6095f672981e934f11. Latest consensus state: current_term: 1 leader_uuid: "b794f66b94174d6095f672981e934f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b794f66b94174d6095f672981e934f11" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40613 } } }
I20260929 22:45:37.769485 17814 sys_catalog.cc:458] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.769941 17816 sys_catalog.cc:455] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b794f66b94174d6095f672981e934f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b794f66b94174d6095f672981e934f11" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40613 } } }
I20260929 22:45:37.770015 17813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.764592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59006 (local address 127.12.27.190:40613)
0929 22:45:37.764779 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.764786 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.764929 (+ 143us) server_negotiation.cc:407] Connection header received
0929 22:45:37.765482 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.765492 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.765568 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.765717 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.766000 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.766864 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.768001 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.768407 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.768532 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.769291 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.769295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.769295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.769490 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.769532 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.769546 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.769607 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.769701 (+ 94us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.769780 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260929 22:45:37.770020 17816 sys_catalog.cc:458] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.770406 17819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:37.770879 17819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:37.771127 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:45:37.772684 17819 catalog_manager.cc:1347] Generated new cluster ID: 902d0119ab844bda91eb8cf4967e3317
I20260929 22:45:37.772737 17819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:37.795140 17819 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:37.795732 17819 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:37.799067 17819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b794f66b94174d6095f672981e934f11: Generated new TSK 0
I20260929 22:45:37.799247 17819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:45:37.811473 17813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.807962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59016 (local address 127.12.27.190:40613)
0929 22:45:37.808032 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.808034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.808146 (+ 112us) server_negotiation.cc:407] Connection header received
0929 22:45:37.808223 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.808224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.808237 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.808325 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:45:37.808448 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.808940 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.809717 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.809932 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.810021 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.810209 (+ 188us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:45:37.811245 (+ 1036us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 22:45:37.811389 (+ 144us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59016: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":45}
W20260929 22:45:37.811537 17813 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59016: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260929 22:45:37.811548 17838 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:37.807895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40613 (local address 127.0.0.1:59016)
0929 22:45:37.808075 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:37.808084 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:37.808164 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:37.808324 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:37.808325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:37.808326 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:45:37.808383 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:37.808385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.809032 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.809034 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:37.809633 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:37.809634 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.810032 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.810034 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:37.810087 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.810092 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:45:37.811347 (+ 1255us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 22:45:37.811437 (+ 90us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.27.190:40613: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":108,"threads_started":1}
I20260929 22:45:37.811942 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17742
E20260929 22:45:37.824292 17839 webserver.cc:533] Webserver: sslize failed:
E20260929 22:45:37.824358 17839 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-29T22:45:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (209 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-29T22:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:37Z Disabled control of system clock
I20260929 22:45:37.857426 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39283
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:44833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:39283
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/testchainca.cert with env {}
W20260929 22:45:37.935755 17843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:37.935953 17843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:37.935976 17843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:37.937093 17843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:37.937125 17843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:37.937139 17843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:37.937151 17843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:37.937163 17843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 22:45:37.937175 17843 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 22:45:37.937186 17843 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260929 22:45:37.938580 17843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:44833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:39283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:37.938767 17843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:37.938921 17843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:37.943681 17851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:37.943689 17848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:37.943691 17849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:37.943977 17843 server_base.cc:1034] running on GCE node
I20260929 22:45:37.944161 17843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:37.944377 17843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:37.945518 17843 hybrid_clock.cc:648] HybridClock initialized: now 1790721937945504 us; error 28 us; skew 500 ppm
I20260929 22:45:37.946758 17843 webserver.cc:460] Webserver started at http://127.12.27.190:45971/ using document root <none> and password file <none>
I20260929 22:45:37.946997 17843 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:37.947045 17843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:37.947208 17843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:37.948276 17843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "be38d03d5fa84a4e872b370ef68082a2"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "d5dd2852e97934c3a81633d98be397c8"
server_key_iv: "703a5c1ad7ae76739d5a126ee7e2d5be"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.948628 17843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "be38d03d5fa84a4e872b370ef68082a2"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "d5dd2852e97934c3a81633d98be397c8"
server_key_iv: "703a5c1ad7ae76739d5a126ee7e2d5be"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.949857 17843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:37.950516 17857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:37.950695 17843 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:37.950807 17843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "be38d03d5fa84a4e872b370ef68082a2"
format_stamp: "Formatted at 2026-09-29 22:45:37 on dist-test-slave-00d6"
server_key: "d5dd2852e97934c3a81633d98be397c8"
server_key_iv: "703a5c1ad7ae76739d5a126ee7e2d5be"
server_key_version: "encryptionkey@0"
I20260929 22:45:37.950879 17843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:37.963147 17843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:37.963378 17843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:37.963474 17843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:37.967317 17843 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:39283
I20260929 22:45:37.967347 17909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:39283 every 8 connection(s)
I20260929 22:45:37.967730 17843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:37.968786 17910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:37.971040 17910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2: Bootstrap starting.
I20260929 22:45:37.971089 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17843
I20260929 22:45:37.971202 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:37.971385 12398 external_mini_cluster.cc:1428] Setting key fff70278c3531ee9823c19f3a1c9bde2
I20260929 22:45:37.971801 17910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:37.972162 17910 log.cc:824] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:37.972922 17910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2: No bootstrap required, opened a new log
I20260929 22:45:37.975252 17910 raft_consensus.cc:348] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be38d03d5fa84a4e872b370ef68082a2" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39283 } }
I20260929 22:45:37.975417 17910 raft_consensus.cc:374] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:37.975448 17910 raft_consensus.cc:729] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be38d03d5fa84a4e872b370ef68082a2, State: Initialized, Role: FOLLOWER
I20260929 22:45:37.975558 17910 consensus_queue.cc:260] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be38d03d5fa84a4e872b370ef68082a2" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39283 } }
I20260929 22:45:37.975660 17910 raft_consensus.cc:388] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:37.975708 17910 raft_consensus.cc:482] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:37.975752 17910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:37.976387 17910 raft_consensus.cc:504] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be38d03d5fa84a4e872b370ef68082a2" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39283 } }
I20260929 22:45:37.976508 17910 leader_election.cc:302] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be38d03d5fa84a4e872b370ef68082a2; no voters:
I20260929 22:45:37.976670 17910 leader_election.cc:288] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:37.976697 17915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:37.976814 17915 raft_consensus.cc:686] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [term 1 LEADER]: Becoming Leader. State: Replica: be38d03d5fa84a4e872b370ef68082a2, State: Running, Role: LEADER
I20260929 22:45:37.976891 17915 consensus_queue.cc:237] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be38d03d5fa84a4e872b370ef68082a2" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39283 } }
I20260929 22:45:37.976926 17910 sys_catalog.cc:564] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:37.977203 17915 sys_catalog.cc:455] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be38d03d5fa84a4e872b370ef68082a2. Latest consensus state: current_term: 1 leader_uuid: "be38d03d5fa84a4e872b370ef68082a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be38d03d5fa84a4e872b370ef68082a2" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39283 } } }
I20260929 22:45:37.977216 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be38d03d5fa84a4e872b370ef68082a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be38d03d5fa84a4e872b370ef68082a2" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39283 } } }
I20260929 22:45:37.977280 17915 sys_catalog.cc:458] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.977324 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:37.977828 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:37.971850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34768 (local address 127.12.27.190:39283)
0929 22:45:37.972059 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:37.972067 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:37.972105 (+ 38us) server_negotiation.cc:407] Connection header received
0929 22:45:37.972674 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:37.972684 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:37.972756 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:37.972930 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:37.973144 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.974526 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.975260 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:37.975900 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:37.976024 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:37.976678 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:37.976682 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:37.976682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:45:37.976890 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:37.976930 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:45:37.976943 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:37.977242 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:37.977274 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 22:45:37.977351 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260929 22:45:37.977836 17921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:37.978668 17921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:37.978945 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:45:37.980389 17921 catalog_manager.cc:1347] Generated new cluster ID: e4a859fadde94b1b9c86ae32d4497fa7
I20260929 22:45:37.980448 17921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:37.993127 17921 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:37.993798 17921 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:38.003223 17921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be38d03d5fa84a4e872b370ef68082a2: Generated new TSK 0
I20260929 22:45:38.003400 17921 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:45:38.070919 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:38.009090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34778 (local address 127.12.27.190:39283)
0929 22:45:38.009163 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:38.009166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:38.009256 (+ 90us) server_negotiation.cc:407] Connection header received
0929 22:45:38.009330 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:38.009331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:38.009341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:38.009395 (+ 54us) server_negotiation.cc:226] Negotiated authn=JWT
0929 22:45:38.009522 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:38.010000 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:38.011122 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:38.011309 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:38.011355 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:38.011553 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 22:45:38.070714 (+ 59161us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 22:45:38.070859 (+ 145us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34778: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":50}
W20260929 22:45:38.071022 17913 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34778: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260929 22:45:38.071295 17939 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:38.009029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39283 (local address 127.0.0.1:34778)
0929 22:45:38.009183 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:38.009194 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:38.009261 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:38.009404 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:38.009405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:38.009407 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 22:45:38.009464 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:38.009466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:38.010079 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:38.010080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:38.011042 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:38.011045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:38.011400 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:38.011401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:38.011460 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:38.011466 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 22:45:38.070898 (+ 59432us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 22:45:38.071185 (+ 287us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.27.190:39283: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":111,"threads_started":1}
I20260929 22:45:38.071617 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17843
2026-09-29T22:45:38Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (238 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (87 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (85 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:38 dist-test-slave-00d6 krb5kdc[17951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:38 dist-test-slave-00d6 krb5kdc[17951](info): set up 2 sockets
Sep 29 22:45:38 dist-test-slave-00d6 krb5kdc[17951](info): commencing operation
krb5kdc: starting...
W20260929 22:45:39.304311 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:45:39.422768 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40411
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:40411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:39.502857 17964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:39.503108 17964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:39.503144 17964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:39.504360 17964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:39.504424 17964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:39.504447 17964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:39.504468 17964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:39.504500 17964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:39.505928 17964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:40411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:39.506211 17964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:39.506434 17964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:39.511153 17972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:39.511204 17970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:39.511153 17969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:39.511336 17964 server_base.cc:1034] running on GCE node
I20260929 22:45:39.511577 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:39.511885 17964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:39.513031 17964 hybrid_clock.cc:648] HybridClock initialized: now 1790721939513011 us; error 41 us; skew 500 ppm
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:39.521903 17964 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:45:39.522400 17964 webserver.cc:460] Webserver started at http://127.12.27.190:44077/ using document root <none> and password file <none>
I20260929 22:45:39.522646 17964 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:39.522691 17964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:39.522833 17964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:39.523967 17964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "5bf3c997642b403a9a5d2e6f1391bdef"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "5418204ea20847f562634f1e3d98ee75"
server_key_iv: "25b601f61ad7e64d593183e499672d00"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.524317 17964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "5bf3c997642b403a9a5d2e6f1391bdef"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "5418204ea20847f562634f1e3d98ee75"
server_key_iv: "25b601f61ad7e64d593183e499672d00"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.525625 17964 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:39.526367 17979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.526595 17964 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:39.526705 17964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "5bf3c997642b403a9a5d2e6f1391bdef"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "5418204ea20847f562634f1e3d98ee75"
server_key_iv: "25b601f61ad7e64d593183e499672d00"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.526778 17964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:39.543969 17964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:39.545898 17964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:39.546058 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:39.550117 17964 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:40411
I20260929 22:45:39.550158 18031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:40411 every 8 connection(s)
I20260929 22:45:39.550515 17964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:39.551368 18032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:39.553673 18032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef: Bootstrap starting.
I20260929 22:45:39.554250 18032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:39.554548 18032 log.cc:824] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:39.555203 18032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef: No bootstrap required, opened a new log
I20260929 22:45:39.556861 18032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40411 } }
I20260929 22:45:39.556998 18032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:39.557019 18032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bf3c997642b403a9a5d2e6f1391bdef, State: Initialized, Role: FOLLOWER
I20260929 22:45:39.557164 18032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40411 } }
I20260929 22:45:39.557245 18032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:39.557287 18032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:39.557364 18032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:39.557534 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 17964
I20260929 22:45:39.557642 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:39.557811 12398 external_mini_cluster.cc:1428] Setting key 7e320a6488226ddf4849653417b2c45f
I20260929 22:45:39.558009 18032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40411 } }
I20260929 22:45:39.558135 18032 leader_election.cc:302] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bf3c997642b403a9a5d2e6f1391bdef; no voters:
I20260929 22:45:39.558306 18032 leader_election.cc:288] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:39.558509 18035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:39.558562 18032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:39.558637 18035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [term 1 LEADER]: Becoming Leader. State: Replica: 5bf3c997642b403a9a5d2e6f1391bdef, State: Running, Role: LEADER
I20260929 22:45:39.558727 18035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40411 } }
I20260929 22:45:39.559095 18039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bf3c997642b403a9a5d2e6f1391bdef. Latest consensus state: current_term: 1 leader_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40411 } } }
I20260929 22:45:39.559234 18039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:39.559464 18046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:39.559619 18037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf3c997642b403a9a5d2e6f1391bdef" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40411 } } }
I20260929 22:45:39.559753 18037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:39.559988 18046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:39.561555 18046 catalog_manager.cc:1347] Generated new cluster ID: 69d4741b4b5a4b768a2c650f5cc34a52
I20260929 22:45:39.561600 18046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:39.570346 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:39.558338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51836 (local address 127.12.27.190:40411)
0929 22:45:39.558720 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:39.558730 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:39.558947 (+ 217us) server_negotiation.cc:407] Connection header received
0929 22:45:39.559104 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:39.559113 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:39.559182 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:39.559348 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:39.560564 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.561834 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.562893 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.563548 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.563699 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:39.566468 (+ 2769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:39.566472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:39.566472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:39.566483 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:39.568538 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:39.568962 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:39.568965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:39.568965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:39.569075 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:39.569293 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:39.569293 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:39.569294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:39.569584 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:39.569718 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:39.569973 (+ 255us) server_negotiation.cc:299] Negotiation successful
0929 22:45:39.570118 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":127,"threads_started":1}
I20260929 22:45:39.579972 18046 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:39.580685 18046 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:39.587828 18046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bf3c997642b403a9a5d2e6f1391bdef: Generated new TSK 0
I20260929 22:45:39.588050 18046 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:45:39.676833 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40411
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:39.759279 18058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:39.759574 18058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:39.759614 18058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:39.760880 18058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:39.760941 18058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:39.760999 18058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:39.762544 18058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:39.762795 18058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:39.763028 18058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:39.768128 18066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:39.768146 18063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:39.768430 18058 server_base.cc:1034] running on GCE node
W20260929 22:45:39.768129 18064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:39.768759 18058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:39.768975 18058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:39.770152 18058 hybrid_clock.cc:648] HybridClock initialized: now 1790721939770136 us; error 37 us; skew 500 ppm
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:39.772939 18058 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:45:39.773453 18058 webserver.cc:460] Webserver started at http://127.12.27.129:35089/ using document root <none> and password file <none>
I20260929 22:45:39.773682 18058 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:39.773751 18058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:39.773907 18058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:39.774976 18058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "f1567c3ac8464133bc7e4d303f2c2af9"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "0a81d77e07cd937f983e75fa3c84522e"
server_key_iv: "638c938e15b4564ffc933fd19a71b703"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.775349 18058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "f1567c3ac8464133bc7e4d303f2c2af9"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "0a81d77e07cd937f983e75fa3c84522e"
server_key_iv: "638c938e15b4564ffc933fd19a71b703"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.776798 18058 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:39.777683 18073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.777935 18058 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:39.778046 18058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "f1567c3ac8464133bc7e4d303f2c2af9"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "0a81d77e07cd937f983e75fa3c84522e"
server_key_iv: "638c938e15b4564ffc933fd19a71b703"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.778139 18058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:39.797693 18058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:39.800063 18058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:39.800230 18058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:39.800493 18058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:39.800807 18058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:39.800863 18058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.800901 18058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:39.800927 18058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.806663 18058 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:41587
I20260929 22:45:39.806708 18186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:41587 every 8 connection(s)
I20260929 22:45:39.807016 18058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:39.813277 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18058
I20260929 22:45:39.813355 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:39.813531 12398 external_mini_cluster.cc:1428] Setting key 20abfd542de7b955b2145fd016ae7804
I20260929 22:45:39.816723 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:39.807907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42791 (local address 127.12.27.190:40411)
0929 22:45:39.807970 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:39.807973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:39.808049 (+ 76us) server_negotiation.cc:407] Connection header received
0929 22:45:39.808949 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:39.808951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:39.808965 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:39.809024 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:39.809625 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.810126 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.811085 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.811288 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.811345 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:39.813552 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:39.813553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:39.813554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:39.813563 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:39.815294 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:39.815730 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:39.815732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:39.815732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:39.815793 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:39.816068 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:39.816069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:39.816070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:39.816185 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:39.816260 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:39.816550 (+ 290us) server_negotiation.cc:299] Negotiation successful
0929 22:45:39.816636 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:45:39.816905 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:39.807763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40411 (local address 127.12.27.129:42791)
0929 22:45:39.807915 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:39.807956 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:39.808839 (+ 883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:39.809078 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:39.809082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:39.809321 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:39.809512 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:39.809524 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.810206 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.810207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:39.810995 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:39.810997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.811366 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.811367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:39.811482 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:39.812005 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:39.812013 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:39.813455 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:39.815375 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:39.815381 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:39.815383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:39.815632 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:39.815862 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:39.815863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:39.815864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:39.815976 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:39.816250 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:39.816257 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:39.816398 (+ 141us) client_negotiation.cc:769] Sending connection context
0929 22:45:39.816515 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 22:45:39.816668 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
I20260929 22:45:39.817541 18187 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40411
I20260929 22:45:39.817634 18187 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:39.817826 18187 heartbeater.cc:511] Master 127.12.27.190:40411 requested a full tablet report, sending...
I20260929 22:45:39.818358 17996 ts_manager.cc:194] Registered new tserver with Master: f1567c3ac8464133bc7e4d303f2c2af9 (127.12.27.129:41587)
I20260929 22:45:39.818967 17996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:42791
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:45:39.839330 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40411
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:39.922720 18192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:39.922972 18192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:39.923014 18192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:39.924239 18192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:39.924302 18192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:39.924346 18192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:39.925791 18192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:39.926049 18192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:39.926270 18192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:39.931352 18200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:39.931453 18197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:39.931352 18198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:39.931511 18192 server_base.cc:1034] running on GCE node
I20260929 22:45:39.931799 18192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:39.932102 18192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:39.933265 18192 hybrid_clock.cc:648] HybridClock initialized: now 1790721939933251 us; error 26 us; skew 500 ppm
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:39.935787 18192 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:45:39.936246 18192 webserver.cc:460] Webserver started at http://127.12.27.130:34821/ using document root <none> and password file <none>
I20260929 22:45:39.936499 18192 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:39.936568 18192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:39.936718 18192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:39.937772 18192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "e8c6da6c8eac4c3d994469e143596151"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "df17623a20ede8d0d9fa8398b231b5d3"
server_key_iv: "716a29971dc7702adc4b18667bc91217"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.938131 18192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "e8c6da6c8eac4c3d994469e143596151"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "df17623a20ede8d0d9fa8398b231b5d3"
server_key_iv: "716a29971dc7702adc4b18667bc91217"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.939445 18192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:39.940297 18207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.940470 18192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:39.940582 18192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "e8c6da6c8eac4c3d994469e143596151"
format_stamp: "Formatted at 2026-09-29 22:45:39 on dist-test-slave-00d6"
server_key: "df17623a20ede8d0d9fa8398b231b5d3"
server_key_iv: "716a29971dc7702adc4b18667bc91217"
server_key_version: "encryptionkey@0"
I20260929 22:45:39.940665 18192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:39.948783 18192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:39.950563 18192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:39.950721 18192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:39.950942 18192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:39.951246 18192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:39.951300 18192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.951355 18192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:39.951380 18192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:39.957266 18192 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:35559
I20260929 22:45:39.957316 18320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:35559 every 8 connection(s)
I20260929 22:45:39.957628 18192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:45:39 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:39.964085 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18192
I20260929 22:45:39.964190 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:39.964373 12398 external_mini_cluster.cc:1428] Setting key f53d48100ac7c2faf3d0a9b2981b9ff9
I20260929 22:45:39.967404 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:39.958316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:59373 (local address 127.12.27.190:40411)
0929 22:45:39.958383 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:39.958385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:39.958642 (+ 257us) server_negotiation.cc:407] Connection header received
0929 22:45:39.959782 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:39.959784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:39.959797 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:39.959842 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:39.960465 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.960993 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.961993 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.962190 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.962266 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:39.964482 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:39.964483 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:39.964484 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:39.964493 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:39.965968 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:39.966413 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:39.966414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:39.966415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:39.966483 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:39.966737 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:39.966738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:39.966739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:39.966861 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:39.966936 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:39.967200 (+ 264us) server_negotiation.cc:299] Negotiation successful
0929 22:45:39.967284 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:45:39.967568 18323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:39.958342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40411 (local address 127.12.27.130:59373)
0929 22:45:39.958511 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:39.958545 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:39.959664 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:39.959909 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:39.959913 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:39.960187 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:39.960367 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:39.960371 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.961089 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.961090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:39.961894 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:39.961896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:39.962270 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:39.962271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:39.962398 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:39.962873 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:39.962881 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:39.964386 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:39.966090 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:39.966097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:39.966100 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:39.966329 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:39.966552 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:39.966553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:39.966553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:39.966660 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:39.966928 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:39.966934 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:39.967067 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 22:45:39.967179 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 22:45:39.967336 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260929 22:45:39.968114 18321 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40411
I20260929 22:45:39.968231 18321 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:39.968410 18321 heartbeater.cc:511] Master 127.12.27.190:40411 requested a full tablet report, sending...
I20260929 22:45:39.968832 17996 ts_manager.cc:194] Registered new tserver with Master: e8c6da6c8eac4c3d994469e143596151 (127.12.27.130:35559)
I20260929 22:45:39.969362 17996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:59373
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:45:39.990147 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40411
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:40.071115 18326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:40.071326 18326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:40.071350 18326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:40.072558 18326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:40.072603 18326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:40.072630 18326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:40.074150 18326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:40.074339 18326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:40.074517 18326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:40.079485 18331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:40.079463 18332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:40.079463 18334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:40.079545 18326 server_base.cc:1034] running on GCE node
I20260929 22:45:40.079885 18326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:40.080183 18326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:40.081334 18326 hybrid_clock.cc:648] HybridClock initialized: now 1790721940081307 us; error 37 us; skew 500 ppm
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.083948 18326 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:45:40.084420 18326 webserver.cc:460] Webserver started at http://127.12.27.131:34393/ using document root <none> and password file <none>
I20260929 22:45:40.084678 18326 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:40.084748 18326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:40.084899 18326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:40.085974 18326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "41b284c0035f47138f54b9a2deb011e0"
format_stamp: "Formatted at 2026-09-29 22:45:40 on dist-test-slave-00d6"
server_key: "9994ffef835cb69a1d4ea705c73960d3"
server_key_iv: "e1ba972c7f158decd6a31704717b4c17"
server_key_version: "encryptionkey@0"
I20260929 22:45:40.086334 18326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "41b284c0035f47138f54b9a2deb011e0"
format_stamp: "Formatted at 2026-09-29 22:45:40 on dist-test-slave-00d6"
server_key: "9994ffef835cb69a1d4ea705c73960d3"
server_key_iv: "e1ba972c7f158decd6a31704717b4c17"
server_key_version: "encryptionkey@0"
I20260929 22:45:40.087628 18326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:45:40.088476 18341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:40.088670 18326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:40.088742 18326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "41b284c0035f47138f54b9a2deb011e0"
format_stamp: "Formatted at 2026-09-29 22:45:40 on dist-test-slave-00d6"
server_key: "9994ffef835cb69a1d4ea705c73960d3"
server_key_iv: "e1ba972c7f158decd6a31704717b4c17"
server_key_version: "encryptionkey@0"
I20260929 22:45:40.088792 18326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:40.098296 18326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:40.100103 18326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:40.100208 18326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:40.100378 18326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:40.100612 18326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:40.100641 18326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:40.100662 18326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:40.100675 18326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:40.106050 18326 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38547
I20260929 22:45:40.106137 18454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38547 every 8 connection(s)
I20260929 22:45:40.106421 18326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:45:40.114780 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18326
I20260929 22:45:40.114861 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:40.115029 12398 external_mini_cluster.cc:1428] Setting key b3bed5c5a9769cb037648d2fed134af9
I20260929 22:45:40.115772 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:40.107124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:56045 (local address 127.12.27.190:40411)
0929 22:45:40.107187 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.107189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.107393 (+ 204us) server_negotiation.cc:407] Connection header received
0929 22:45:40.108375 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.108376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.108386 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.108443 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.109041 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.109543 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.110514 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.110696 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.110758 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:40.112914 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:40.112916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:40.112916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:40.112922 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:40.114243 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.114628 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.114629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.114629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.114696 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.115005 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.115006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.115007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.115162 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:40.115249 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:40.115580 (+ 331us) server_negotiation.cc:299] Negotiation successful
0929 22:45:40.115684 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:45:40.115960 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:40.107087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40411 (local address 127.12.27.131:56045)
0929 22:45:40.107271 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:40.107311 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:40.108286 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:40.108509 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:40.108513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:40.108752 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:40.108928 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:40.108961 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.109618 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.109619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:40.110410 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:40.110412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.110772 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.110773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:40.110862 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:40.111384 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:40.111392 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:40.112813 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:40.114314 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:40.114319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:40.114320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:40.114530 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:40.114762 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:40.114762 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:40.114763 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:40.114889 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:40.115240 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:40.115246 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:40.115415 (+ 169us) client_negotiation.cc:769] Sending connection context
0929 22:45:40.115544 (+ 129us) client_negotiation.cc:240] Negotiation successful
0929 22:45:40.115719 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":119,"threads_started":1}
I20260929 22:45:40.116410 18455 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40411
I20260929 22:45:40.116511 18455 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:40.116678 18455 heartbeater.cc:511] Master 127.12.27.190:40411 requested a full tablet report, sending...
I20260929 22:45:40.117029 17996 ts_manager.cc:194] Registered new tserver with Master: 41b284c0035f47138f54b9a2deb011e0 (127.12.27.131:38547)
I20260929 22:45:40.117398 17996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:56045
I20260929 22:45:40.127069 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/test-admin.keytab.
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.144232 12398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260929 22:45:40.145865 18462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:40.145150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44794 (local address 127.12.27.129:41587)
0929 22:45:40.145318 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.145323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.145332 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:40.145357 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.145359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.145371 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.145441 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.145786 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44794: BlockingRecv error: recv got EOF from 127.0.0.1:44794 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
W20260929 22:45:40.146055 12398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc' of type FILE
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.147006 12398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.147900 12398 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:40.155385 18462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:40.148373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44800 (local address 127.12.27.129:41587)
0929 22:45:40.148445 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.148446 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.148499 (+ 53us) server_negotiation.cc:407] Connection header received
0929 22:45:40.148539 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.148540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.148549 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.148595 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.148960 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.149654 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.150414 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.150729 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.150789 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:40.152940 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:40.152947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:40.152947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:40.152954 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:40.154422 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.154730 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.154733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.154733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.154788 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.154953 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.154954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.154954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.155085 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:40.155204 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:40.155244 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 22:45:40.155302 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260929 22:45:40.157181 18462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:40.156654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44802 (local address 127.12.27.129:41587)
0929 22:45:40.156707 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.156713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.156725 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:45:40.156784 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.156784 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.156792 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.156837 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.157092 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44802: BlockingRecv error: recv got EOF from 127.0.0.1:44802 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 22:45:40.157269 12398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc' of type FILE
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.158285 12398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.159191 12398 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:40.165891 18462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:40.159747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44804 (local address 127.12.27.129:41587)
0929 22:45:40.159783 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.159785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.159803 (+ 18us) server_negotiation.cc:407] Connection header received
0929 22:45:40.159845 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.159846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.159854 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.159894 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.160285 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.160761 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.161448 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.161657 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.161743 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:40.163579 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:40.163580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:40.163580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:40.163587 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:40.164816 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.165168 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.165169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.165170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.165226 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.165416 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.165417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.165417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.165521 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:40.165619 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:40.165735 (+ 116us) server_negotiation.cc:299] Negotiation successful
0929 22:45:40.165802 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:45:40.167307 18462 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:45:40.166791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44816 (local address 127.12.27.129:41587)
0929 22:45:40.166852 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.166854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.166900 (+ 46us) server_negotiation.cc:407] Connection header received
0929 22:45:40.166960 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.166961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.166970 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.167017 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.167262 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44816: BlockingRecv error: recv got EOF from 127.0.0.1:44816 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260929 22:45:40.167447 12398 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790721915685765-12398-0/krb5kdc/krb5cc)
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.168478 12398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:40.169274 12398 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.129@KRBTEST.COM
I20260929 22:45:40.176224 18462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:40.169721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44826 (local address 127.12.27.129:41587)
0929 22:45:40.169777 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:40.169779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:40.169854 (+ 75us) server_negotiation.cc:407] Connection header received
0929 22:45:40.169925 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:40.169926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:40.169963 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:40.170027 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:40.170379 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.170877 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.171567 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:40.171806 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:40.171862 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:40.173879 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:40.173880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:40.173880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:40.173886 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:40.175234 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.175560 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.175560 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.175561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.175606 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:40.175847 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:40.175847 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:40.175848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:40.175946 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:40.176015 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:40.176120 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 22:45:40.176170 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 22:45:40.176811 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18058
I20260929 22:45:40.182272 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18192
I20260929 22:45:40.186724 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18326
I20260929 22:45:40.190968 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 17964
2026-09-29T22:45:40Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1949 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[18475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[18475](info): set up 2 sockets
Sep 29 22:45:40 dist-test-slave-00d6 krb5kdc[18475](info): commencing operation
krb5kdc: starting...
W20260929 22:45:41.228411 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:45:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:45:41Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab.
Entry for principal oryx/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab.
I20260929 22:45:41.358403 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:43113
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab
--principal=oryx/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:43113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:41.437108 18488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:41.437350 18488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:41.437386 18488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:41.438514 18488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:41.438586 18488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:41.438611 18488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:41.438642 18488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:41.438674 18488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:41.440145 18488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:43113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab
--principal=oryx/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:43113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:41.440410 18488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:41.440636 18488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:41.445838 18496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.445858 18494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.445856 18493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:41.446127 18488 server_base.cc:1034] running on GCE node
I20260929 22:45:41.446367 18488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:41.446709 18488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:41.447868 18488 hybrid_clock.cc:648] HybridClock initialized: now 1790721941447855 us; error 25 us; skew 500 ppm
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:41.450223 18488 init.cc:377] Logged in from keytab as oryx/127.12.27.190@KRBTEST.COM (short username oryx)
I20260929 22:45:41.450578 18488 webserver.cc:460] Webserver started at http://127.12.27.190:44455/ using document root <none> and password file <none>
I20260929 22:45:41.450762 18488 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:41.450801 18488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:41.450884 18488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:41.451924 18488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "9cfd7779b4bd4893a126d3dc56545683"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "8edaf99f6fd20d5ef6f26dc81067578e"
server_key_iv: "dd75e1e0a6dacf211f93edd65d547ea8"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.452230 18488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "9cfd7779b4bd4893a126d3dc56545683"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "8edaf99f6fd20d5ef6f26dc81067578e"
server_key_iv: "dd75e1e0a6dacf211f93edd65d547ea8"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.453548 18488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:41.454257 18503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.454435 18488 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:41.454511 18488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "9cfd7779b4bd4893a126d3dc56545683"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "8edaf99f6fd20d5ef6f26dc81067578e"
server_key_iv: "dd75e1e0a6dacf211f93edd65d547ea8"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.454564 18488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:41.475344 18488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:41.477820 18488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:41.477932 18488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:41.481613 18488 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:43113
I20260929 22:45:41.481667 18555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:43113 every 8 connection(s)
I20260929 22:45:41.482012 18488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:45:41.482782 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18488
I20260929 22:45:41.482903 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:45:41.483134 18556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:41.483146 12398 external_mini_cluster.cc:1428] Setting key a4f0d3b545f82774dcd847e23a4d7da4
I20260929 22:45:41.485891 18556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Bootstrap starting.
I20260929 22:45:41.486465 18556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:41.486743 18556 log.cc:824] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:41.487394 18556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: No bootstrap required, opened a new log
I20260929 22:45:41.489209 18556 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } }
I20260929 22:45:41.489387 18556 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:41.489421 18556 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfd7779b4bd4893a126d3dc56545683, State: Initialized, Role: FOLLOWER
I20260929 22:45:41.489542 18556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } }
I20260929 22:45:41.489645 18556 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:45:41.489678 18556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:45:41.489725 18556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 0 FOLLOWER]: Advancing to term 1
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:45:41.490449 18556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } }
I20260929 22:45:41.490540 18556 leader_election.cc:302] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cfd7779b4bd4893a126d3dc56545683; no voters:
I20260929 22:45:41.490739 18556 leader_election.cc:288] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:45:41.490767 18561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:41.490878 18561 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfd7779b4bd4893a126d3dc56545683, State: Running, Role: LEADER
I20260929 22:45:41.490957 18561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } }
I20260929 22:45:41.491001 18556 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:41.491248 18561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cfd7779b4bd4893a126d3dc56545683. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } }
I20260929 22:45:41.491329 18561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:41.491532 18565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:45:41.491261 18562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } }
I20260929 22:45:41.491649 18562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:41.492050 18565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:45:41.494097 18565 catalog_manager.cc:1347] Generated new cluster ID: 10bdd2124ac14f9498dfd4cc675c678f
I20260929 22:45:41.494148 18565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:45:41.494385 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:41.483742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37930 (local address 127.12.27.190:43113)
0929 22:45:41.483952 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:41.483960 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:41.483984 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:45:41.484549 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:41.484556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:41.484604 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:41.484754 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:41.485416 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.486375 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.487241 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.487762 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.487879 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:41.490414 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:41.490417 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:41.490418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:41.490427 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:41.492742 (+ 2315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:41.493163 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:41.493166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:41.493167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:41.493263 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:41.493506 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:41.493507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:41.493508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:41.493818 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:41.493979 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:41.494091 (+ 112us) server_negotiation.cc:299] Negotiation successful
0929 22:45:41.494226 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":86,"threads_started":1}
I20260929 22:45:41.511737 18565 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:45:41.512250 18565 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:45:41.520056 18565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Generated new TSK 0
I20260929 22:45:41.520257 18565 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab.
Entry for principal oryx/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab.
I20260929 22:45:41.551311 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43113
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:41.652495 18582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:41.652691 18582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:41.652716 18582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:41.653870 18582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:41.653913 18582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:41.653939 18582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:41.655376 18582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:41.655652 18582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:41.655886 18582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:41.660856 18590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.660835 18587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:41.660950 18582 server_base.cc:1034] running on GCE node
W20260929 22:45:41.660887 18588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:41.661278 18582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:41.661522 18582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:41.662681 18582 hybrid_clock.cc:648] HybridClock initialized: now 1790721941662665 us; error 30 us; skew 500 ppm
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:41.665294 18582 init.cc:377] Logged in from keytab as oryx/127.12.27.129@KRBTEST.COM (short username oryx)
I20260929 22:45:41.665745 18582 webserver.cc:460] Webserver started at http://127.12.27.129:42643/ using document root <none> and password file <none>
I20260929 22:45:41.665992 18582 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:41.666061 18582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:41.666205 18582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:41.667232 18582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "4af1f213f2724ac6a9db58b773c97b96"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "4415c4824eee2009451a8ce74d78deaf"
server_key_iv: "82192a9e86f22249219873e186043de4"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.667588 18582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "4af1f213f2724ac6a9db58b773c97b96"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "4415c4824eee2009451a8ce74d78deaf"
server_key_iv: "82192a9e86f22249219873e186043de4"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.668902 18582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:41.669608 18597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.669773 18582 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:41.669870 18582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "4af1f213f2724ac6a9db58b773c97b96"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "4415c4824eee2009451a8ce74d78deaf"
server_key_iv: "82192a9e86f22249219873e186043de4"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.669947 18582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:41.679291 18582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:41.681092 18582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:41.681245 18582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:41.681453 18582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:41.681746 18582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:41.681798 18582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.681838 18582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:41.681862 18582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.687624 18582 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:45159
I20260929 22:45:41.687687 18710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:45159 every 8 connection(s)
I20260929 22:45:41.688048 18582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:45:41.696657 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18582
I20260929 22:45:41.696765 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:45:41.696982 12398 external_mini_cluster.cc:1428] Setting key 6e3feea864c40a236f30a6cd6752f485
I20260929 22:45:41.697517 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:41.688675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:46011 (local address 127.12.27.190:43113)
0929 22:45:41.688717 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:41.688719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:41.689008 (+ 289us) server_negotiation.cc:407] Connection header received
0929 22:45:41.689523 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:41.689524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:41.689536 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:41.689598 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:41.690565 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.691148 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.692345 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.692556 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.692662 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:41.694754 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:41.694756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:41.694756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:41.694763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:41.696051 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:41.696446 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:41.696447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:41.696448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:41.696506 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:41.696784 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:41.696786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:41.696786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:41.696971 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:41.697067 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:41.697376 (+ 309us) server_negotiation.cc:299] Negotiation successful
0929 22:45:41.697456 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:45:41.697743 18713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:41.688664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:46011)
0929 22:45:41.688848 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:41.688894 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:41.689402 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:41.689671 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:41.689675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:41.690229 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:41.690461 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:41.690466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.691236 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.691237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:41.692252 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:41.692255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.692668 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.692669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:41.692817 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:41.693277 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:41.693284 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:41.694637 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:41.696142 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:41.696148 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:41.696150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:41.696360 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:41.696575 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:41.696576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:41.696577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:41.696686 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:41.697063 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:41.697069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:41.697222 (+ 153us) client_negotiation.cc:769] Sending connection context
0929 22:45:41.697350 (+ 128us) client_negotiation.cc:240] Negotiation successful
0929 22:45:41.697519 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260929 22:45:41.698252 18711 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43113
I20260929 22:45:41.698352 18711 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:41.698521 18711 heartbeater.cc:511] Master 127.12.27.190:43113 requested a full tablet report, sending...
I20260929 22:45:41.699021 18520 ts_manager.cc:194] Registered new tserver with Master: 4af1f213f2724ac6a9db58b773c97b96 (127.12.27.129:45159)
I20260929 22:45:41.699736 18520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:46011
WARNING: no policy specified for oryx/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab.
Entry for principal oryx/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab.
I20260929 22:45:41.721823 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43113
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:41.803594 18716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:41.803885 18716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:41.803938 18716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:41.805440 18716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:41.805485 18716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:41.805542 18716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:41.807134 18716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:41.807402 18716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:41.807705 18716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:41.813573 18721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.813602 18722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.813573 18724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:41.813836 18716 server_base.cc:1034] running on GCE node
I20260929 22:45:41.814049 18716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:41.814316 18716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:41.815483 18716 hybrid_clock.cc:648] HybridClock initialized: now 1790721941815467 us; error 25 us; skew 500 ppm
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:41.818073 18716 init.cc:377] Logged in from keytab as oryx/127.12.27.130@KRBTEST.COM (short username oryx)
I20260929 22:45:41.818545 18716 webserver.cc:460] Webserver started at http://127.12.27.130:39035/ using document root <none> and password file <none>
I20260929 22:45:41.818773 18716 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:41.818837 18716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:41.818976 18716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:41.820107 18716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "fcd3442e107e4d93add22e46a1ba14d9"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d7b37199551efd405105331bff344da8"
server_key_iv: "3585ecde8a0537f97eb43d41668203be"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.820465 18716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "fcd3442e107e4d93add22e46a1ba14d9"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d7b37199551efd405105331bff344da8"
server_key_iv: "3585ecde8a0537f97eb43d41668203be"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.821733 18716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:41.822449 18731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.822618 18716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:41.822715 18716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "fcd3442e107e4d93add22e46a1ba14d9"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d7b37199551efd405105331bff344da8"
server_key_iv: "3585ecde8a0537f97eb43d41668203be"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.822795 18716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:41.838102 18716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:41.840524 18716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:41.840718 18716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:41.840989 18716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:41.841302 18716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:41.841354 18716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.841394 18716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:41.841423 18716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.847306 18716 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:38653
I20260929 22:45:41.847385 18844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:38653 every 8 connection(s)
I20260929 22:45:41.847728 18716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:45:41.856446 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:41.848475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:50159 (local address 127.12.27.190:43113)
0929 22:45:41.848542 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:41.848544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:41.848741 (+ 197us) server_negotiation.cc:407] Connection header received
0929 22:45:41.849203 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:41.849204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:41.849215 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:41.849265 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:41.850130 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.850611 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.851563 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.851768 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.851821 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:41.853940 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:41.853941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:41.853941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:41.853948 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:41.855161 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:41.855520 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:41.855521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:41.855522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:41.855569 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:41.855828 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:41.855829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:41.855829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:41.855934 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:41.855991 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:41.856317 (+ 326us) server_negotiation.cc:299] Negotiation successful
0929 22:45:41.856381 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:45:41.856751 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:41.848438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:50159)
0929 22:45:41.848625 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:41.848660 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:41.849124 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:41.849316 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:41.849319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:41.849861 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:41.850056 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:41.850061 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.850685 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.850685 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:41.851490 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:41.851491 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:41.851826 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:41.851827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:41.851924 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:41.852491 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:41.852499 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:41.853847 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:41.855236 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:41.855241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:41.855243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:41.855451 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:41.855624 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:41.855665 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:41.855665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:41.855769 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:41.856045 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:41.856050 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:41.856169 (+ 119us) client_negotiation.cc:769] Sending connection context
0929 22:45:41.856290 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 22:45:41.856468 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":108,"threads_started":1}
I20260929 22:45:41.856738 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18716
I20260929 22:45:41.856848 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:45:41.857059 12398 external_mini_cluster.cc:1428] Setting key fd995bb37f34d76a7b2f1931d51e6782
I20260929 22:45:41.857328 18845 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43113
I20260929 22:45:41.857427 18845 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:41.857609 18845 heartbeater.cc:511] Master 127.12.27.190:43113 requested a full tablet report, sending...
I20260929 22:45:41.858042 18520 ts_manager.cc:194] Registered new tserver with Master: fcd3442e107e4d93add22e46a1ba14d9 (127.12.27.130:38653)
I20260929 22:45:41.858403 18520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:50159
WARNING: no policy specified for oryx/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab.
Entry for principal oryx/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab.
I20260929 22:45:41.883766 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43113
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:41.964095 18850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:41.964300 18850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:41.964323 18850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:41.965474 18850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:41.965517 18850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:41.965543 18850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:41.967002 18850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:41.967247 18850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:41.967491 18850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:41.972422 18856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.972433 18858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:41.972433 18855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:41.972607 18850 server_base.cc:1034] running on GCE node
I20260929 22:45:41.972818 18850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:41.973101 18850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:41.974298 18850 hybrid_clock.cc:648] HybridClock initialized: now 1790721941974291 us; error 39 us; skew 500 ppm
Sep 29 22:45:41 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:41.976927 18850 init.cc:377] Logged in from keytab as oryx/127.12.27.131@KRBTEST.COM (short username oryx)
I20260929 22:45:41.977352 18850 webserver.cc:460] Webserver started at http://127.12.27.131:33063/ using document root <none> and password file <none>
I20260929 22:45:41.977591 18850 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:41.977658 18850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:41.977809 18850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:41.978869 18850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "099d2a136ade45b6a57e16564d7c8d52"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d38acb5bc4718fd5816ca95f63c10d73"
server_key_iv: "b2294337698c9ecc6c1bf0535fb1de76"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.979223 18850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "099d2a136ade45b6a57e16564d7c8d52"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d38acb5bc4718fd5816ca95f63c10d73"
server_key_iv: "b2294337698c9ecc6c1bf0535fb1de76"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.980568 18850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:45:41.981273 18865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:41.981441 18850 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:41.981544 18850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "099d2a136ade45b6a57e16564d7c8d52"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d38acb5bc4718fd5816ca95f63c10d73"
server_key_iv: "b2294337698c9ecc6c1bf0535fb1de76"
server_key_version: "encryptionkey@0"
I20260929 22:45:41.981617 18850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:41.998095 18850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.000612 18850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:42.000787 18850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.001014 18850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:42.001334 18850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:42.001390 18850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.001441 18850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:42.001468 18850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.007215 18850 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:46763
I20260929 22:45:42.007287 18978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:46763 every 8 connection(s)
I20260929 22:45:42.007689 18850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:42.008411 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18850
I20260929 22:45:42.008510 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:45:42.008703 12398 external_mini_cluster.cc:1428] Setting key f9a0e171ee5ba5ffab46837549eb2759
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:45:42.017736 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.008482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:49333 (local address 127.12.27.190:43113)
0929 22:45:42.008555 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.008558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.008744 (+ 186us) server_negotiation.cc:407] Connection header received
0929 22:45:42.009582 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.009583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.009596 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.009649 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.010677 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.011198 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.012301 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.012509 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.012597 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.014816 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.014817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.014818 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.014825 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.016458 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.016840 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.016842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.016842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.016898 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.017179 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.017180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.017180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.017287 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.017339 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.017600 (+ 261us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.017670 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 22:45:42.018069 18981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.008467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:49333)
0929 22:45:42.008627 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.008669 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.009452 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.009719 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.009724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.010381 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.010578 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.010584 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.011303 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.011304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.012186 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.012189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.012606 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.012607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.012738 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.013274 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.013283 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.014701 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.016529 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.016535 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.016537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.016752 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.016993 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.016994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.016995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.017112 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.017359 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.017364 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.017480 (+ 116us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.017573 (+ 93us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.017709 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260929 22:45:42.018510 18979 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43113
I20260929 22:45:42.018586 18979 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.018791 18979 heartbeater.cc:511] Master 127.12.27.190:43113 requested a full tablet report, sending...
I20260929 22:45:42.019208 18520 ts_manager.cc:194] Registered new tserver with Master: 099d2a136ade45b6a57e16564d7c8d52 (127.12.27.131:46763)
I20260929 22:45:42.019585 18520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:49333
I20260929 22:45:42.020377 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.27.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.189.keytab.
Entry for principal oryx/127.12.27.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.189.keytab.
I20260929 22:45:42.047482 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:45819
--webserver_interface=127.12.27.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.189.keytab
--principal=oryx/127.12.27.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:43113,127.12.27.189:45819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:42.127178 18984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:42.127379 18984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:42.127400 18984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:42.128547 18984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:42.128588 18984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:42.128602 18984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:42.128645 18984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:42.128674 18984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:42.130064 18984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:43113,127.12.27.189:45819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.189.keytab
--principal=oryx/127.12.27.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:45819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.27.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
W20260929 22:45:42.130198 18984 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.27.190:43113,127.12.27.189:45819'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260929 22:45:42.130342 18984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:42.130576 18984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.135231 18992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.135241 18989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.135236 18990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.135510 18984 server_base.cc:1034] running on GCE node
I20260929 22:45:42.135759 18984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.136000 18984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.137140 18984 hybrid_clock.cc:648] HybridClock initialized: now 1790721942137126 us; error 28 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.139532 18984 init.cc:377] Logged in from keytab as oryx/127.12.27.189@KRBTEST.COM (short username oryx)
I20260929 22:45:42.140005 18984 webserver.cc:460] Webserver started at http://127.12.27.189:43007/ using document root <none> and password file <none>
I20260929 22:45:42.140235 18984 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.140304 18984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.140452 18984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:42.141502 18984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/instance:
uuid: "3d87286f7c034beaab192a63d46fba75"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "89c5d35980678ebd31ec63fe9b71dd6d"
server_key_iv: "00b89257490dc9ec05087a3b4342fc2d"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.141860 18984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal/instance:
uuid: "3d87286f7c034beaab192a63d46fba75"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "89c5d35980678ebd31ec63fe9b71dd6d"
server_key_iv: "00b89257490dc9ec05087a3b4342fc2d"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.143126 18984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:45:42.143857 18999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.144024 18984 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:42.144120 18984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
uuid: "3d87286f7c034beaab192a63d46fba75"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "89c5d35980678ebd31ec63fe9b71dd6d"
server_key_iv: "00b89257490dc9ec05087a3b4342fc2d"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.144197 18984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.163050 18984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.164948 18984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:42.165114 18984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.169100 18984 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.189:45819
I20260929 22:45:42.169134 19051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.189:45819 every 8 connection(s)
I20260929 22:45:42.169480 18984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
I20260929 22:45:42.170444 19052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:42.172127 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 18984
I20260929 22:45:42.172032 19052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.189@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
I20260929 22:45:42.181631 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.172903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37936 (local address 127.12.27.190:43113)
0929 22:45:42.172996 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.172999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.173069 (+ 70us) server_negotiation.cc:407] Connection header received
0929 22:45:42.173641 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.173642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.173655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.173715 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.174259 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.174790 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.175816 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.176032 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.176117 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.178486 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.178487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.178487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.178501 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.180162 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.180657 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.180658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.180658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.180722 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.180974 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.180975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.180975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.181131 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.181212 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.181463 (+ 251us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.181540 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260929 22:45:42.181849 19055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.172720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.12.27.189:45819)
0929 22:45:42.173001 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.173005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.173042 (+ 37us) server_negotiation.cc:407] Connection header received
0929 22:45:42.173519 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.173525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.173545 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.173652 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.174241 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.175026 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.175876 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.176194 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.176276 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.178929 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.178936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.178936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.178943 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.180568 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.180907 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.180910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.180910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.180967 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.181167 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.181168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.181168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.181341 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.181495 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.181580 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.181654 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":106,"threads_started":1}
I20260929 22:45:42.181854 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.172797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:37936)
0929 22:45:42.172933 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.172973 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.173536 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.173735 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.173738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.174003 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.174156 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.174160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.174892 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.174893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.175735 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.175737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.176126 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.176127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.176234 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.176740 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.176750 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.178360 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.180263 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.180269 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.180271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.180567 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.180796 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.180796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.180797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.180903 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.181202 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.181207 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.181338 (+ 131us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.181438 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.181584 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260929 22:45:42.182536 19052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.189@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
I20260929 22:45:42.188326 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.182763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.0.0.1:54316)
0929 22:45:42.182850 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.182860 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.182904 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.183040 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.183041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.183145 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.183173 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.183175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.183796 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.183797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.184336 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.184338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.184689 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.184690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.184736 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.185149 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.185153 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.186345 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.187541 (+ 1196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.187542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.187542 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.187758 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.187904 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.187904 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.187904 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.187953 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.188108 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.188109 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.188138 (+ 29us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.188181 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.188247 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260929 22:45:42.188413 19055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.182815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54316 (local address 127.12.27.189:45819)
0929 22:45:42.182848 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.182850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.182951 (+ 101us) server_negotiation.cc:407] Connection header received
0929 22:45:42.182965 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.182966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.182979 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.183021 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.183231 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.183737 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.184433 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.184631 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.184682 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.186416 (+ 1734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.186417 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.186417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.186423 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.187476 (+ 1053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.187818 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.187818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.187819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.187863 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.187993 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.187993 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.187993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.188074 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.188116 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.188196 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.188290 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":15}
I20260929 22:45:42.189558 19052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Bootstrap starting.
I20260929 22:45:42.190358 19052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:42.190644 19052 log.cc:824] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:42.191478 19052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: No bootstrap required, opened a new log
I20260929 22:45:42.193002 19052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } }
I20260929 22:45:42.193148 19052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:42.193197 19052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d87286f7c034beaab192a63d46fba75, State: Initialized, Role: FOLLOWER
I20260929 22:45:42.193327 19052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } }
I20260929 22:45:42.193616 19052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:42.193580 19058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } }
I20260929 22:45:42.193730 19058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:45:42.195077 19069 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:45:42.195130 19069 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:45:42.196694 18984 master_runner.cc:428] Detected that this master 3d87286f7c034beaab192a63d46fba75 is joining an existing cluster
I20260929 22:45:42.196748 18984 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.27.189:45819
I20260929 22:45:42.204221 19076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.197868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.0.0.1:54332)
0929 22:45:42.198082 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.198091 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.198149 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.198293 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.198294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.198473 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.198540 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.198541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.199133 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.199133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.200042 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.200044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.200437 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.200437 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.200470 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.200924 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.200928 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.201388 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.203147 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.203148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.203148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.203324 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.203526 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.203526 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.203527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.203581 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.203853 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.203854 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.203890 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.203959 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.204066 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":59,"threads_started":1}
I20260929 22:45:42.204233 19055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.198014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54332 (local address 127.12.27.189:45819)
0929 22:45:42.198044 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.198046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.198131 (+ 85us) server_negotiation.cc:407] Connection header received
0929 22:45:42.198207 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.198208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.198217 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.198242 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.198617 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.199052 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.200127 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.200351 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.200379 (+ 28us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.201479 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.201480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.201481 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.201486 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.203054 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.203408 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.203409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.203410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.203461 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.203687 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.203688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.203688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.203789 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.203863 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.203983 (+ 120us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.204142 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":16}
I20260929 22:45:42.205161 19075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.197645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:37938)
0929 22:45:42.197779 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.197791 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.197846 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.198078 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.198079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.198285 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.198372 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.198374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.199300 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.199300 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.200128 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.200130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.200595 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.200595 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.200664 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.201081 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.201085 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.201429 (+ 344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.203560 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.203561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.203561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.203808 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.204042 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.204043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.204044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.204095 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.204826 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.204827 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.204873 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.204941 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.205045 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":88,"threads_started":1}
I20260929 22:45:42.205253 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.197723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.12.27.190:43113)
0929 22:45:42.197775 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.197778 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.197853 (+ 75us) server_negotiation.cc:407] Connection header received
0929 22:45:42.197919 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.197920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.197932 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.197984 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.198457 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.199218 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.200208 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.200511 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.200583 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.201517 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.201518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.201519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.201525 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.203467 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.203903 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.203905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.203905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.203960 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.204167 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.204168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.204168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.204728 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.204777 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.205074 (+ 297us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.205145 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.190@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
I20260929 22:45:42.214094 19055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.207328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54342 (local address 127.12.27.189:45819)
0929 22:45:42.207366 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.207368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.207489 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:45:42.207573 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.207574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.207584 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.207665 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.208062 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.208498 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.209253 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.209441 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.209530 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.211697 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.211698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.211699 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.211705 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.212960 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.213337 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.213338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.213338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.213395 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.213599 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.213600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.213600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.213698 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.213769 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.213940 (+ 171us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.214008 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:45:42.214170 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.207264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.0.0.1:54342)
0929 22:45:42.207377 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.207415 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.207509 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.207651 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.207655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.207926 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.207968 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.207970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.208582 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.208583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.209162 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.209164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.209547 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.209548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.209638 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.210143 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.210148 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.211573 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.213058 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.213065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.213067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.213262 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.213464 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.213465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.213465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.213527 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.213762 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.213768 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.213817 (+ 49us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.213916 (+ 99us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.214046 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":62,"threads_started":1}
I20260929 22:45:42.214680 18520 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.27.189:45819: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3d87286f7c034beaab192a63d46fba75"
member_type: NON_VOTER
last_known_addr {
host: "127.12.27.189"
port: 45819
}
attrs {
promote: true
}
}
dest_uuid: "9cfd7779b4bd4893a126d3dc56545683"
cas_config_opid_index: -1
I20260929 22:45:42.214979 18520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } }
I20260929 22:45:42.215444 19079 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3d87286f7c034beaab192a63d46fba75 (127.12.27.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.215761 19026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:42.216548 19079 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.27.189:45819
I20260929 22:45:42.216646 19026 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Refusing update from remote peer 9cfd7779b4bd4893a126d3dc56545683: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260929 22:45:42.216703 19079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.216758 19079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:42.216753 18984 master.cc:537] Master@127.12.27.189:45819 shutting down...
I20260929 22:45:42.217037 19079 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 22:45:42.217700 18505 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260929 22:45:42.218119 18505 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 -> Peer 3d87286f7c034beaab192a63d46fba75 (127.12.27.189:45819): Couldn't send request to peer 3d87286f7c034beaab192a63d46fba75. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 22:45:42.219522 18984 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:42.219609 18984 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:42.219682 18984 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: stopping tablet replica
I20260929 22:45:42.232450 18984 master.cc:552] Master@127.12.27.189:45819 shutdown complete.
I20260929 22:45:42.232523 18984 master_runner.cc:305] Clearing existing system tablet
I20260929 22:45:42.232649 18984 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.232709 18984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.233393 18984 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260929 22:45:42.233845 19083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.234004 18984 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.234059 18984 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.234081 18984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
uuid: "3d87286f7c034beaab192a63d46fba75"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "89c5d35980678ebd31ec63fe9b71dd6d"
server_key_iv: "00b89257490dc9ec05087a3b4342fc2d"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.234687 18984 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:42.236160 18984 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 22:45:42.236244 18984 log.cc:1196] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260929 22:45:42.236429 18984 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Deleting consensus metadata
I20260929 22:45:42.236554 18984 master_runner.cc:315] Copying system tablet from 127.12.27.190:43113
I20260929 22:45:42.237198 18984 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: tablet copy: Beginning tablet copy session from remote peer at address 127.12.27.190:43113
I20260929 22:45:42.243566 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.237532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:37950)
0929 22:45:42.237682 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.237691 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.237751 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.237880 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.237880 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.238035 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.238094 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.238096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.239029 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.239030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.239557 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.239559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.240122 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.240123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.240177 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.240666 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.240670 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.240949 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.242650 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.242651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.242651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.242810 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.243011 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.243012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.243012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.243061 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.243312 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.243313 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.243348 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.243396 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.243469 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260929 22:45:42.243595 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.237585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37950 (local address 127.12.27.190:43113)
0929 22:45:42.237626 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.237628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.237764 (+ 136us) server_negotiation.cc:407] Connection header received
0929 22:45:42.237797 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.237798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.237810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.237877 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.238162 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.238949 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.239702 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.240034 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.240105 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.241035 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.241036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.241037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.241044 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.242566 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.242882 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.242883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.242883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.242943 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.243120 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.243121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.243121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.243252 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.243321 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.243419 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.243503 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:45:42.243973 18540 tablet_copy_service.cc:140] P 9cfd7779b4bd4893a126d3dc56545683: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3d87286f7c034beaab192a63d46fba75 ({username='oryx', principal='oryx/127.12.27.189@KRBTEST.COM'} at 127.0.0.1:37950)
I20260929 22:45:42.244100 18540 tablet_copy_service.cc:161] P 9cfd7779b4bd4893a126d3dc56545683: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3d87286f7c034beaab192a63d46fba75 at {username='oryx', principal='oryx/127.12.27.189@KRBTEST.COM'} at 127.0.0.1:37950: session id = 3d87286f7c034beaab192a63d46fba75-00000000000000000000000000000000
I20260929 22:45:42.244728 18540 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 22:45:42.245325 18984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 22:45:42.246209 18984 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: tablet copy: Starting download of 0 data blocks...
I20260929 22:45:42.246371 18984 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: tablet copy: Starting download of 1 WAL segments...
I20260929 22:45:42.247212 18984 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 22:45:42.248025 18540 tablet_copy_service.cc:342] P 9cfd7779b4bd4893a126d3dc56545683: Request end of tablet copy session 3d87286f7c034beaab192a63d46fba75-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.27.189@KRBTEST.COM'} at 127.0.0.1:37950
I20260929 22:45:42.248087 18540 tablet_copy_service.cc:433] P 9cfd7779b4bd4893a126d3dc56545683: ending tablet copy session 3d87286f7c034beaab192a63d46fba75-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3d87286f7c034beaab192a63d46fba75
I20260929 22:45:42.250295 18984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.251467 19090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.251578 19091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.252556 19093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.252578 18984 server_base.cc:1034] running on GCE node
I20260929 22:45:42.252729 18984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.252895 18984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.254022 18984 hybrid_clock.cc:648] HybridClock initialized: now 1790721942254016 us; error 25 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.255321 18984 init.cc:377] Logged in from keytab as oryx/127.12.27.189@KRBTEST.COM (short username oryx)
I20260929 22:45:42.255610 18984 webserver.cc:460] Webserver started at http://127.12.27.189:43471/ using document root <none> and password file <none>
I20260929 22:45:42.255777 18984 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.255826 18984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.256429 18984 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:42.256978 19100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.257079 18984 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:42.257122 18984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
uuid: "3d87286f7c034beaab192a63d46fba75"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "89c5d35980678ebd31ec63fe9b71dd6d"
server_key_iv: "00b89257490dc9ec05087a3b4342fc2d"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.257179 18984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.267620 18984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.269399 18984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.272413 18984 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.189:45819
I20260929 22:45:42.272672 19152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.189:45819 every 8 connection(s)
I20260929 22:45:42.272779 18984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
I20260929 22:45:42.273656 19153 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:45:42.274164 19153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Bootstrap starting.
I20260929 22:45:42.277017 19153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:45:42.277261 19153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: Bootstrap complete.
I20260929 22:45:42.277485 19153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } }
I20260929 22:45:42.277577 19153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3d87286f7c034beaab192a63d46fba75, State: Initialized, Role: LEARNER
I20260929 22:45:42.277616 19153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } }
I20260929 22:45:42.277781 19153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:42.277803 19156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.277912 19156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:45:42.279289 19167 catalog_manager.cc:1259] Loaded cluster ID: 10bdd2124ac14f9498dfd4cc675c678f
I20260929 22:45:42.279336 19167 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: loading cluster ID for follower catalog manager: success
I20260929 22:45:42.280366 19167 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: acquiring CA information for follower catalog manager: success
I20260929 22:45:42.280647 19167 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:45:42.290860 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.283882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54360 (local address 127.12.27.189:45819)
0929 22:45:42.283997 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.283999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.284009 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:42.284036 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.284037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.284050 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.284115 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.284855 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.285490 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.286504 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.286688 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.286732 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.288207 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.288209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.288209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.288214 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.289636 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.290032 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.290032 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.290033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.290080 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.290302 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.290302 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.290303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.290420 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.290496 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.290645 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.290744 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for oryx/127.12.27.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.188.keytab.
Entry for principal oryx/127.12.27.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.188.keytab.
I20260929 22:45:42.318346 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:42949
--webserver_interface=127.12.27.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.188.keytab
--principal=oryx/127.12.27.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:45:42.409380 19171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:42.409613 19171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:42.409636 19171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:42.410820 19171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:45:42.410864 19171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:42.410878 19171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:42.410892 19171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:45:42.410903 19171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:45:42.412415 19171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.188.keytab
--principal=oryx/127.12.27.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:42949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.27.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:42.412612 19171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:42.412786 19171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.417613 19177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.417644 19171 server_base.cc:1034] running on GCE node
W20260929 22:45:42.417613 19179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.417603 19176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.418054 19171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.418354 19171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.419514 19171 hybrid_clock.cc:648] HybridClock initialized: now 1790721942419504 us; error 45 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.421856 19171 init.cc:377] Logged in from keytab as oryx/127.12.27.188@KRBTEST.COM (short username oryx)
I20260929 22:45:42.422282 19171 webserver.cc:460] Webserver started at http://127.12.27.188:36921/ using document root <none> and password file <none>
I20260929 22:45:42.422519 19171 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.422587 19171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.422736 19171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:45:42.423872 19171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/instance:
uuid: "4d8a1ea70e73407683864bf00c1c69ea"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "aa7c34e0533a55e0885bb292e7314517"
server_key_iv: "b93323019ba2d70acf69676cf991eacd"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.424218 19171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal/instance:
uuid: "4d8a1ea70e73407683864bf00c1c69ea"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "aa7c34e0533a55e0885bb292e7314517"
server_key_iv: "b93323019ba2d70acf69676cf991eacd"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.425570 19171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:45:42.426290 19186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.426492 19171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:42.426586 19171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
uuid: "4d8a1ea70e73407683864bf00c1c69ea"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "aa7c34e0533a55e0885bb292e7314517"
server_key_iv: "b93323019ba2d70acf69676cf991eacd"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.426666 19171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.440150 19171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.441969 19171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:42.442127 19171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.445955 19171 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.188:42949
I20260929 22:45:42.445984 19238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.188:42949 every 8 connection(s)
I20260929 22:45:42.446334 19171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
I20260929 22:45:42.447160 19239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:42.448731 19239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:45:42.453363 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 19171
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.188@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:45:42.458252 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.449579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.12.27.190:43113)
0929 22:45:42.449624 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.449626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.449718 (+ 92us) server_negotiation.cc:407] Connection header received
0929 22:45:42.450157 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.450158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.450168 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.450218 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.450752 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.451240 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.452265 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.452446 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.452513 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.455042 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.455044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.455045 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.455053 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.456631 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.457112 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.457114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.457114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.457179 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.457505 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.457506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.457506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.457615 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.457717 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.458069 (+ 352us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.458153 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:42.458483 19241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.449403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:37962)
0929 22:45:42.449594 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.449644 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.450075 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.450266 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.450269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.450506 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.450685 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.450688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.451316 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.451316 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.452195 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.452198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.452537 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.452540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.452637 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.453076 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.453084 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.454957 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.456726 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.456733 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.456735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.456961 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.457266 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.457267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.457268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.457429 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.457723 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.457729 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.457891 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.458031 (+ 140us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.458255 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260929 22:45:42.459031 19239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.27.188@KRBTEST.COM
I20260929 22:45:42.462419 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.453870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57544 (local address 127.12.27.188:42949)
0929 22:45:42.454036 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.454039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.454054 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:45:42.454072 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.454073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.454088 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.454150 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.454879 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.455719 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.456429 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.456741 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.456819 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.459618 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.459642 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.459643 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.459649 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.461202 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.461588 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.461590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.461591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.461648 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.461831 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.461832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.461832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.462002 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.462147 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.462218 (+ 71us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.462296 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.188@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
I20260929 22:45:42.465601 19241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.459305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.0.0.1:54364)
0929 22:45:42.459437 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.459448 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.459500 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.459695 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.459695 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.459826 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.459892 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.459894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.460834 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.460835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.461383 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.461385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.461891 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.461892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.461949 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.462371 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.462376 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.463564 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.464866 (+ 1302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.464867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.464867 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.465020 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.465185 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.465186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.465186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.465234 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.465401 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.465402 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.465438 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.465483 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.465546 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260929 22:45:42.465619 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.459379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54364 (local address 127.12.27.189:45819)
0929 22:45:42.459420 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.459422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.459485 (+ 63us) server_negotiation.cc:407] Connection header received
0929 22:45:42.459564 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.459565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.459592 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.459692 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.459969 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.460743 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.461505 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.461819 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.461881 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.463694 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.463696 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.463696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.463703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.464802 (+ 1099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.465084 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.465084 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.465085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.465129 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.465272 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.465272 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.465272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.465353 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.465395 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.465505 (+ 110us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.465563 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:42.466003 19239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.188@KRBTEST.COM for oryx/127.12.27.188@KRBTEST.COM
I20260929 22:45:42.471503 19241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.466234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.0.0.1:57560)
0929 22:45:42.466278 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.466288 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.466327 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.466442 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.466443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.466542 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.466566 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.466567 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.467102 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.467103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.467549 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.467550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.467933 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.467934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.467971 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.468265 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.468268 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.469320 (+ 1052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.470790 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.470791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.470791 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.470937 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.471097 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.471097 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.471098 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.471142 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.471302 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.471303 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.471331 (+ 28us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.471379 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.471446 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:45:42.471566 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.466303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57560 (local address 127.12.27.188:42949)
0929 22:45:42.466334 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.466336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.466343 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:42.466363 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.466364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.466372 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.466430 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.466623 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.467044 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.467614 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.467869 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.467913 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.469392 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.469393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.469394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.469399 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.470725 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.470998 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.470998 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.470999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.471043 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.471178 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.471179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.471179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.471256 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.471297 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.471393 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.471496 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":15}
I20260929 22:45:42.472867 19239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Bootstrap starting.
I20260929 22:45:42.473739 19239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:42.474014 19239 log.cc:824] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:42.474721 19239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: No bootstrap required, opened a new log
I20260929 22:45:42.476341 19239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } }
I20260929 22:45:42.476467 19239 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:42.476490 19239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d8a1ea70e73407683864bf00c1c69ea, State: Initialized, Role: FOLLOWER
I20260929 22:45:42.476650 19239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } }
I20260929 22:45:42.477067 19239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:42.477051 19244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } } }
I20260929 22:45:42.477190 19244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:45:42.478838 19255 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:45:42.478895 19255 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:45:42.481067 19171 master_runner.cc:428] Detected that this master 4d8a1ea70e73407683864bf00c1c69ea is joining an existing cluster
I20260929 22:45:42.481117 19171 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.27.188:42949
I20260929 22:45:42.489861 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.482653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54380 (local address 127.12.27.189:45819)
0929 22:45:42.482691 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.482693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.482899 (+ 206us) server_negotiation.cc:407] Connection header received
0929 22:45:42.483004 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.483005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.483016 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.483047 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.483421 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.484167 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.485205 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.485525 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.485564 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.487089 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.487091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.487091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.487099 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.488689 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.489116 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.489117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.489118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.489176 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.489354 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.489355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.489355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.489469 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.489549 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.489698 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.489770 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:45:42.489876 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.482736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.0.0.1:54380)
0929 22:45:42.482842 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.482851 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.482921 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.483108 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.483109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.483279 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.483338 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.483340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.484273 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.484274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.485112 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.485114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.485985 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.485986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.486047 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.486561 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.486566 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.486989 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.488779 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.488780 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.488780 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.489028 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.489231 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.489232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.489232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.489285 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.489549 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.489550 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.489593 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.489675 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.489771 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
I20260929 22:45:42.500608 19244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:42.500718 19244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } }
I20260929 22:45:42.501071 19244 leader_election.cc:288] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113), 3d87286f7c034beaab192a63d46fba75 (127.12.27.189:45819)
I20260929 22:45:42.501292 19127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d8a1ea70e73407683864bf00c1c69ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d87286f7c034beaab192a63d46fba75" is_pre_election: true
I20260929 22:45:42.501303 18530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d8a1ea70e73407683864bf00c1c69ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfd7779b4bd4893a126d3dc56545683" is_pre_election: true
I20260929 22:45:42.501412 19127 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Handling vote request from an unknown peer 4d8a1ea70e73407683864bf00c1c69ea
I20260929 22:45:42.501456 19127 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 4d8a1ea70e73407683864bf00c1c69ea for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260929 22:45:42.501678 19189 leader_election.cc:302] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d8a1ea70e73407683864bf00c1c69ea; no voters: 3d87286f7c034beaab192a63d46fba75, 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:45:42.501803 19244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:42.502561 19244 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 22:45:42.510783 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.482299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57576 (local address 127.12.27.188:42949)
0929 22:45:42.482334 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.482336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.482413 (+ 77us) server_negotiation.cc:407] Connection header received
0929 22:45:42.485065 (+ 2652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.485066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.485076 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.485104 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.485548 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.486189 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.487173 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.487783 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.488110 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.489120 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.489121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.489122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.489128 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.509559 (+ 20431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.509954 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.509956 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.509956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.510020 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.510238 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.510239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.510239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.510381 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.510456 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.510591 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.510676 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:45:42.510871 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.482111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.0.0.1:57576)
0929 22:45:42.482351 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.482362 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.482451 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.485153 (+ 2702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.485154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.485411 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.485460 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.485462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.486268 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.486268 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.487089 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.487091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.488131 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.488132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.488209 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.488601 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.488607 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.489040 (+ 433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.509666 (+ 20626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.509667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.509667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.509840 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.510089 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.510090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.510091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.510151 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.510447 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.510447 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.510488 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.510568 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.510731 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":67,"thread_start_us":82,"threads_started":1}
I20260929 22:45:42.511482 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.482141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37972 (local address 127.12.27.190:43113)
0929 22:45:42.482184 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.482186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.482431 (+ 245us) server_negotiation.cc:407] Connection header received
0929 22:45:42.482504 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.482505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.482518 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.482567 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.483019 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.483835 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.484986 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.485297 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.485369 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.508138 (+ 22769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.508140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.508140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.508150 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.509846 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.510490 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.510491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.510492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.510547 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.510745 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.510746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.510746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.510868 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.510907 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.511297 (+ 390us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.511380 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:42.511812 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.482236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:37972)
0929 22:45:42.482372 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.482381 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.482429 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.482625 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.482627 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.482851 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.482930 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.482932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.483958 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.483958 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.484897 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.484898 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.485439 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.485440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.485508 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.485976 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.485982 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.507995 (+ 22013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.509935 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.509936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.509936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.510143 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.510618 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.510618 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.510619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.510677 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.511146 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.511147 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.511186 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.511574 (+ 388us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.511707 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":59,"threads_started":1}
I20260929 22:45:42.513779 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18582
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721941, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.190@KRBTEST.COM for oryx/127.12.27.188@KRBTEST.COM
I20260929 22:45:42.520526 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:45159
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:43113
--webserver_port=42643
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:45:42.521920 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.513924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.0.0.1:57580)
0929 22:45:42.514282 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.514294 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.514338 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.514981 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.514982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.515154 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.515202 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.515204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.516159 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.516160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.516979 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.516981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.517308 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.517309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.517375 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.517804 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.517809 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.519076 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.520886 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.520887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.520887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.521062 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.521241 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.521242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.521242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.521300 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.521559 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.521560 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.521605 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.521672 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.521790 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338}
I20260929 22:45:42.522059 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.514784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57580 (local address 127.12.27.188:42949)
0929 22:45:42.514841 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.514843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.514851 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:42.514885 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.514885 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.514896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.514952 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.515282 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.516062 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.517057 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.517224 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.517297 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.519163 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.519165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.519165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.519172 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.520796 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.521128 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.521128 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.521129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.521171 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.521373 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.521374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.521374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.521491 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.521566 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.521889 (+ 323us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.521968 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:45:42.522607 18520 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.27.188:42949: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea"
member_type: NON_VOTER
last_known_addr {
host: "127.12.27.188"
port: 42949
}
attrs {
promote: true
}
}
dest_uuid: "9cfd7779b4bd4893a126d3dc56545683"
cas_config_opid_index: 5
I20260929 22:45:42.522846 18520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:42.523382 19079 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d8a1ea70e73407683864bf00c1c69ea (127.12.27.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.523533 19213 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 FOLLOWER]: Refusing update from remote peer 9cfd7779b4bd4893a126d3dc56545683: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 22:45:42.523905 19078 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:42.524528 19079 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.27.188:42949
I20260929 22:45:42.524590 19079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.524662 19079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:42.524926 19171 master.cc:537] Master@127.12.27.188:42949 shutting down...
I20260929 22:45:42.525178 19213 raft_consensus.cc:858] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
W20260929 22:45:42.525246 19213 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 42949 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:42.525761 19213 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3d87286f7c034beaab192a63d46fba75 (127.12.27.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.526944 19268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.527061 19268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260929 22:45:42.527107 19268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.527160 19268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260929 22:45:42.527598 19244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cfd7779b4bd4893a126d3dc56545683. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } }
I20260929 22:45:42.527709 19244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260929 22:45:42.527977 19078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.528077 19078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
W20260929 22:45:42.528692 18504 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 -> Peer 4d8a1ea70e73407683864bf00c1c69ea (127.12.27.188:42949): Couldn't send request to peer 4d8a1ea70e73407683864bf00c1c69ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 22:45:42.530498 19171 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260929 22:45:42.530594 19171 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260929 22:45:42.530645 19171 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: stopping tablet replica
I20260929 22:45:42.533721 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.523256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.0.0.1:54388)
0929 22:45:42.523780 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.523790 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.523825 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.528978 (+ 5153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.528980 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.528982 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:42.529023 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.529024 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.529964 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.529966 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.532458 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.532461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.533462 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.533462 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.533541 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.533560 (+ 19us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.533613 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.533652 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509}
I20260929 22:45:42.533731 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.523345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54388 (local address 127.12.27.189:45819)
0929 22:45:42.528291 (+ 4946us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.528294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.528304 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:42.528331 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.528332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.528353 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.528413 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:42.529112 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.529874 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.532577 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.533277 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.533328 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.533401 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.533621 (+ 220us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.533665 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4917}
I20260929 22:45:42.533977 19127 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Refusing update from remote peer 9cfd7779b4bd4893a126d3dc56545683: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 22:45:42.534159 19079 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 22:45:42.534654 19127 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d8a1ea70e73407683864bf00c1c69ea (127.12.27.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.535912 19156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cfd7779b4bd4893a126d3dc56545683. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.535996 19156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:45:42.536031 19156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: NON_VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: true } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.536077 19156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: This master's current role is: LEARNER
I20260929 22:45:42.536273 19079 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: attempting to promote NON_VOTER 3d87286f7c034beaab192a63d46fba75 to VOTER
I20260929 22:45:42.536444 19079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:42.536859 19127 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 LEARNER]: Refusing update from remote peer 9cfd7779b4bd4893a126d3dc56545683: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260929 22:45:42.537019 19274 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260929 22:45:42.537096 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.536816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.0.0.1:57590)
0929 22:45:42.537024 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.537065 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:42949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":64,"threads_started":1}
I20260929 22:45:42.537750 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.537316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.0.0.1:57606)
0929 22:45:42.537696 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.537724 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:42949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369}
I20260929 22:45:42.537740 19078 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3d87286f7c034beaab192a63d46fba75 (127.12.27.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
W20260929 22:45:42.537828 18504 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 -> Peer 4d8a1ea70e73407683864bf00c1c69ea (127.12.27.188:42949): Couldn't send request to peer 4d8a1ea70e73407683864bf00c1c69ea. Status: Network error: Client connection negotiation failed: client connection to 127.12.27.188:42949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 22:45:42.538703 19078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.538772 19078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:42.539014 19079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.539094 19079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683 [sys.catalog]: This master's current role is: LEADER
I20260929 22:45:42.539244 19127 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3d87286f7c034beaab192a63d46fba75 (127.12.27.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.540107 19156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9cfd7779b4bd4893a126d3dc56545683" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.540211 19156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:45:42.544479 19171 master.cc:552] Master@127.12.27.188:42949 shutdown complete.
I20260929 22:45:42.544528 19171 master_runner.cc:305] Clearing existing system tablet
I20260929 22:45:42.544658 19171 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.544704 19171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.545439 19171 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:42.545995 19278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.546141 19171 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.546202 19171 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.546227 19171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
uuid: "4d8a1ea70e73407683864bf00c1c69ea"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "aa7c34e0533a55e0885bb292e7314517"
server_key_iv: "b93323019ba2d70acf69676cf991eacd"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.546913 19171 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:42.548699 19171 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 22:45:42.548771 19171 log.cc:1196] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260929 22:45:42.549010 19171 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Deleting consensus metadata
I20260929 22:45:42.549130 19171 master_runner.cc:315] Copying system tablet from 127.12.27.190:43113
I20260929 22:45:42.549721 19171 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: tablet copy: Beginning tablet copy session from remote peer at address 127.12.27.190:43113
I20260929 22:45:42.556936 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.550092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37976 (local address 127.12.27.190:43113)
0929 22:45:42.550132 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.550135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.550200 (+ 65us) server_negotiation.cc:407] Connection header received
0929 22:45:42.550263 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.550264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.550273 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.550349 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.550688 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.551455 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.552486 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.552795 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.552882 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.553963 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.553964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.553964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.553972 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.555614 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.556013 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.556015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.556015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.556078 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.556281 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.556281 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.556282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.556407 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.556484 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.556692 (+ 208us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.556770 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:45:42.557257 19284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.550028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:37976)
0929 22:45:42.550141 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.550151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.550212 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.550355 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.550356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.550555 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.550610 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.550612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.551542 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.551543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.552386 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.552388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.552889 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.552890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.552950 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.553489 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.553494 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.553866 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.555722 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.555723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.555724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.555938 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.556149 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.556150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.556150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.556214 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.556503 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.556504 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.556553 (+ 49us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.557025 (+ 472us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.557144 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
I20260929 22:45:42.557505 18540 tablet_copy_service.cc:140] P 9cfd7779b4bd4893a126d3dc56545683: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4d8a1ea70e73407683864bf00c1c69ea ({username='oryx', principal='oryx/127.12.27.188@KRBTEST.COM'} at 127.0.0.1:37976)
I20260929 22:45:42.557565 18540 tablet_copy_service.cc:161] P 9cfd7779b4bd4893a126d3dc56545683: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4d8a1ea70e73407683864bf00c1c69ea at {username='oryx', principal='oryx/127.12.27.188@KRBTEST.COM'} at 127.0.0.1:37976: session id = 4d8a1ea70e73407683864bf00c1c69ea-00000000000000000000000000000000
I20260929 22:45:42.558139 18540 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 22:45:42.558609 19171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 22:45:42.559930 19171 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: tablet copy: Starting download of 0 data blocks...
I20260929 22:45:42.560081 19171 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: tablet copy: Starting download of 1 WAL segments...
I20260929 22:45:42.560871 19171 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 22:45:42.561749 18540 tablet_copy_service.cc:342] P 9cfd7779b4bd4893a126d3dc56545683: Request end of tablet copy session 4d8a1ea70e73407683864bf00c1c69ea-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.27.188@KRBTEST.COM'} at 127.0.0.1:37976
I20260929 22:45:42.561798 18540 tablet_copy_service.cc:433] P 9cfd7779b4bd4893a126d3dc56545683: ending tablet copy session 4d8a1ea70e73407683864bf00c1c69ea-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4d8a1ea70e73407683864bf00c1c69ea
I20260929 22:45:42.564141 19171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.565407 19285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.568753 19286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.569038 19171 server_base.cc:1034] running on GCE node
W20260929 22:45:42.569082 19288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.569259 19171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.569397 19171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.570531 19171 hybrid_clock.cc:648] HybridClock initialized: now 1790721942570539 us; error 50 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.572093 19171 init.cc:377] Logged in from keytab as oryx/127.12.27.188@KRBTEST.COM (short username oryx)
I20260929 22:45:42.572371 19171 webserver.cc:460] Webserver started at http://127.12.27.188:36811/ using document root <none> and password file <none>
I20260929 22:45:42.572503 19171 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.572543 19171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.573307 19171 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:45:42.573894 19295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.574060 19171 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:45:42.574116 19171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
uuid: "4d8a1ea70e73407683864bf00c1c69ea"
format_stamp: "Formatted at 2026-09-29 22:45:42 on dist-test-slave-00d6"
server_key: "aa7c34e0533a55e0885bb292e7314517"
server_key_iv: "b93323019ba2d70acf69676cf991eacd"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.574177 19171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.581751 19171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.583820 19171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.586766 19171 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.188:42949
I20260929 22:45:42.587167 19171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
I20260929 22:45:42.587757 19347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.188:42949 every 8 connection(s)
I20260929 22:45:42.588510 19348 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:45:42.588994 19348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Bootstrap starting.
I20260929 22:45:42.591226 19348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:45:42.591450 19348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: Bootstrap complete.
I20260929 22:45:42.591679 19348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:42.591766 19348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4d8a1ea70e73407683864bf00c1c69ea, State: Initialized, Role: LEARNER
I20260929 22:45:42.591800 19348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:42.591961 19348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:45:42.593966 19362 catalog_manager.cc:1259] Loaded cluster ID: 10bdd2124ac14f9498dfd4cc675c678f
I20260929 22:45:42.594017 19362 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: loading cluster ID for follower catalog manager: success
I20260929 22:45:42.595101 19362 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: acquiring CA information for follower catalog manager: success
I20260929 22:45:42.595396 19362 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:45:42.595713 19351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } } }
I20260929 22:45:42.595876 19351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d8a1ea70e73407683864bf00c1c69ea [sys.catalog]: This master's current role is: LEARNER
W20260929 22:45:42.621829 19264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:42.622051 19264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:42.622092 19264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:42.623392 19264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:42.623446 19264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:42.623493 19264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:45:42.625243 19264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:45159
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=42643
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:42.625504 19264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:42.625730 19264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.631582 19367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.631616 19368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.631811 19264 server_base.cc:1034] running on GCE node
W20260929 22:45:42.631934 19370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.632153 19264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.632423 19264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.633617 19264 hybrid_clock.cc:648] HybridClock initialized: now 1790721942633613 us; error 37 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.636418 19264 init.cc:377] Logged in from keytab as oryx/127.12.27.129@KRBTEST.COM (short username oryx)
I20260929 22:45:42.636861 19264 webserver.cc:460] Webserver started at http://127.12.27.129:42643/ using document root <none> and password file <none>
I20260929 22:45:42.637106 19264 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.637161 19264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.638504 19264 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:42.639106 19377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.639269 19264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:42.639360 19264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "4af1f213f2724ac6a9db58b773c97b96"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "4415c4824eee2009451a8ce74d78deaf"
server_key_iv: "82192a9e86f22249219873e186043de4"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.639765 19264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.648100 19264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.649734 19264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:42.649837 19264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.649998 19264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:42.650216 19264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:42.650249 19264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.650270 19264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:42.650282 19264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.655879 19264 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:45159
I20260929 22:45:42.655966 19490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:45159 every 8 connection(s)
I20260929 22:45:42.656287 19264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.188@KRBTEST.COM
I20260929 22:45:42.666170 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 19264
I20260929 22:45:42.666321 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18716
I20260929 22:45:42.667531 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.657104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:58507 (local address 127.12.27.189:45819)
0929 22:45:42.657166 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.657168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.657757 (+ 589us) server_negotiation.cc:407] Connection header received
0929 22:45:42.658123 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.658124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.658136 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.658167 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.658939 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.659679 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.660748 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.661033 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.661095 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.663580 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.663582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.663582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.663588 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.665353 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.665847 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.665848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.665849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.665905 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.666188 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.666189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.666190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.666359 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.666448 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.667360 (+ 912us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.667436 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:45:42.667750 19496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.657047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.12.27.129:58507)
0929 22:45:42.657680 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.657688 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.658035 (+ 347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.658677 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.658678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.658825 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.658879 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.658880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.659772 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.659773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.660645 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.660647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.661112 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.661112 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.661246 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.661916 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.661921 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.663482 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.665441 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.665447 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.665449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.665751 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.665983 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.665983 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.665984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.666115 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.667097 (+ 982us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.667102 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.667216 (+ 114us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.667328 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.667496 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"mutex_wait_us":317,"thread_start_us":69,"threads_started":1}
I20260929 22:45:42.668282 19493 heartbeater.cc:347] Connected to a master server at 127.12.27.189:45819
I20260929 22:45:42.668385 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.657090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:48977 (local address 127.12.27.190:43113)
0929 22:45:42.657302 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.657304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.657630 (+ 326us) server_negotiation.cc:407] Connection header received
0929 22:45:42.658119 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.658120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.658132 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.658197 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.658865 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.659682 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.660907 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.661190 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.661265 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.664495 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.664497 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.664497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.664504 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.666167 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.667276 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.667277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.667277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.667334 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.667535 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.667535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.667536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.667693 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.667738 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.668172 (+ 434us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.668258 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260929 22:45:42.668398 19493 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.668603 19493 heartbeater.cc:511] Master 127.12.27.189:45819 requested a full tablet report, sending...
I20260929 22:45:42.668779 19497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.657046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:48977)
0929 22:45:42.657441 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.657481 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.658015 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.658274 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.658278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.658579 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.658774 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.658777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.659743 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.659744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.660815 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.660817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.661266 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.661267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.661333 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.661851 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.661859 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.664409 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.666298 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.666299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.666299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.667187 (+ 888us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.667405 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.667406 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.667406 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.667466 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.668010 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.668011 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.668055 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.668505 (+ 450us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.668619 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":75,"thread_start_us":88,"threads_started":1}
I20260929 22:45:42.669098 19492 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43113
I20260929 22:45:42.669153 19492 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.669132 19117 ts_manager.cc:194] Registered new tserver with Master: 4af1f213f2724ac6a9db58b773c97b96 (127.12.27.129:45159)
I20260929 22:45:42.669221 19492 heartbeater.cc:511] Master 127.12.27.190:43113 requested a full tablet report, sending...
I20260929 22:45:42.669471 18520 ts_manager.cc:194] Re-registered known tserver with Master: 4af1f213f2724ac6a9db58b773c97b96 (127.12.27.129:45159)
I20260929 22:45:42.669831 18520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:48977
I20260929 22:45:42.672432 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:38653
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:43113
--webserver_port=39035
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:45:42.674270 19498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.657320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:57697 (local address 127.12.27.188:42949)
0929 22:45:42.657423 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.657425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.657575 (+ 150us) server_negotiation.cc:407] Connection header received
0929 22:45:42.658168 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.658169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.658181 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.658238 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.658889 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.659571 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.660915 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.661184 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.661271 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.665034 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.665035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.665036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.665043 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.673078 (+ 8035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.673412 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.673413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.673413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.673477 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.673711 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.673712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.673713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.673869 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.673932 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.674102 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.674170 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":54,"threads_started":1}
I20260929 22:45:42.674520 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.657046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.12.27.129:57697)
0929 22:45:42.657441 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.657481 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.658025 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.658281 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.658282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.658622 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.658774 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.658780 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.659705 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.659706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.660821 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.660822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.661485 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.661486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.661526 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.662089 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.662094 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.664939 (+ 2845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.673168 (+ 8229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.673168 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.673169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.673341 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.673548 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.673548 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.673549 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.673633 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.673936 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.673937 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.673983 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.674077 (+ 94us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.674200 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":98,"thread_start_us":76,"threads_started":1}
I20260929 22:45:42.675074 19491 heartbeater.cc:347] Connected to a master server at 127.12.27.188:42949
I20260929 22:45:42.675134 19491 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.675211 19491 heartbeater.cc:511] Master 127.12.27.188:42949 requested a full tablet report, sending...
I20260929 22:45:42.675572 19303 ts_manager.cc:194] Registered new tserver with Master: 4af1f213f2724ac6a9db58b773c97b96 (127.12.27.129:45159)
W20260929 22:45:42.754705 19499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:42.754956 19499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:42.755004 19499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:42.756345 19499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:42.756407 19499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:42.756454 19499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:45:42.758244 19499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:38653
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=39035
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:42.758507 19499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:42.758730 19499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.763700 19505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.763700 19504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.763728 19507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.763916 19499 server_base.cc:1034] running on GCE node
I20260929 22:45:42.764173 19499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.764403 19499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.765539 19499 hybrid_clock.cc:648] HybridClock initialized: now 1790721942765520 us; error 35 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.767938 19499 init.cc:377] Logged in from keytab as oryx/127.12.27.130@KRBTEST.COM (short username oryx)
I20260929 22:45:42.768376 19499 webserver.cc:460] Webserver started at http://127.12.27.130:39035/ using document root <none> and password file <none>
I20260929 22:45:42.768630 19499 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.768719 19499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.770056 19499 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:42.770624 19514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.770797 19499 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.770876 19499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "fcd3442e107e4d93add22e46a1ba14d9"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d7b37199551efd405105331bff344da8"
server_key_iv: "3585ecde8a0537f97eb43d41668203be"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.771240 19499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.787968 19499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.789812 19499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:42.789976 19499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.790230 19499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:42.790566 19499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:42.790611 19499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.790653 19499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:42.790681 19499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.796883 19499 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:38653
I20260929 22:45:42.796973 19627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:38653 every 8 connection(s)
I20260929 22:45:42.797305 19499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:45:42.798381 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 19499
I20260929 22:45:42.798555 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18850
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.188@KRBTEST.COM
I20260929 22:45:42.807830 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:46763
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:43113
--webserver_port=33063
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:45:42.810061 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.798248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:35057 (local address 127.12.27.189:45819)
0929 22:45:42.798356 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.798359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.798369 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:42.799492 (+ 1123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.799493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.799505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.799570 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.800612 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.801375 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.802965 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.803257 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.803299 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.806231 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.806232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.806233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.806240 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.808370 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.808866 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.808868 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.808868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.808923 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.809215 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.809216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.809216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.809350 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.809394 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.809888 (+ 494us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.809967 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260929 22:45:42.810264 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.797993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.12.27.130:35057)
0929 22:45:42.798225 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.798268 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.799381 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.799670 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.799675 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.800224 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.800501 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.800507 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.801511 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.801512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.802849 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.802851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.803389 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.803390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.803527 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.804203 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.804231 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.806119 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.808472 (+ 2353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.808480 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.808482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.808774 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.809002 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.809003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.809003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.809132 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.809453 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.809460 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.809621 (+ 161us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.809768 (+ 147us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.809942 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":145,"thread_start_us":83,"threads_started":1}
I20260929 22:45:42.810761 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.798305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:35817 (local address 127.12.27.190:43113)
0929 22:45:42.798379 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.798382 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.798393 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:45:42.799507 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.799508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.799521 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.799553 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.800607 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.801412 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.802948 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.803303 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.803344 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.807281 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.807282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.807283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.807290 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.809316 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.809767 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.809769 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.809770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.809865 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.810185 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.810186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.810186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.810329 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.810379 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.810590 (+ 211us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.810674 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:45:42.810771 19633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.797993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:35817)
0929 22:45:42.798254 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.798268 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.799398 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.799671 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.799676 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.800249 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.800502 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.800508 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.801530 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.801531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.802848 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.802851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.803420 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.803420 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.803527 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.804312 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.804317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.807185 (+ 2868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.809423 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.809424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.809425 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.809676 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.810021 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.810022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.810022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.810107 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.810426 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.810427 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.810462 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.810551 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.810652 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":128,"spinlock_wait_cycles":7424,"thread_start_us":93,"threads_started":1}
I20260929 22:45:42.811308 19629 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43113
I20260929 22:45:42.811406 19629 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.811589 19629 heartbeater.cc:511] Master 127.12.27.190:43113 requested a full tablet report, sending...
I20260929 22:45:42.811977 18520 ts_manager.cc:194] Re-registered known tserver with Master: fcd3442e107e4d93add22e46a1ba14d9 (127.12.27.130:38653)
I20260929 22:45:42.812347 18520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:35817
I20260929 22:45:42.812655 19630 heartbeater.cc:347] Connected to a master server at 127.12.27.189:45819
I20260929 22:45:42.812712 19630 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.812780 19630 heartbeater.cc:511] Master 127.12.27.189:45819 requested a full tablet report, sending...
I20260929 22:45:42.813081 19117 ts_manager.cc:194] Registered new tserver with Master: fcd3442e107e4d93add22e46a1ba14d9 (127.12.27.130:38653)
I20260929 22:45:42.813728 19498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.798072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:46749 (local address 127.12.27.188:42949)
0929 22:45:42.798126 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.798128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.798606 (+ 478us) server_negotiation.cc:407] Connection header received
0929 22:45:42.799806 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.799807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.799822 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.799880 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.800613 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.801373 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.802957 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.803263 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.803299 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.810709 (+ 7410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.810710 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.810710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.810717 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.812502 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.812920 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.812922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.812922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.812989 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.813185 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.813186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.813186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.813320 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.813375 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.813593 (+ 218us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.813667 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:45:42.813833 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.797993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.12.27.130:46749)
0929 22:45:42.798543 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.798552 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.799728 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.799926 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.799927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.800200 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.800502 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.800507 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.801511 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.801512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.802849 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.802851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.803391 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.803391 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.803527 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.804260 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.804264 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.810611 (+ 6347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.812590 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.812591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.812592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.812839 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.813063 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.813064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.813064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.813125 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.813437 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.813438 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.813479 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.813549 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.813673 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":165,"thread_start_us":60,"threads_started":1}
I20260929 22:45:42.814229 19628 heartbeater.cc:347] Connected to a master server at 127.12.27.188:42949
I20260929 22:45:42.814277 19628 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.814320 19628 heartbeater.cc:511] Master 127.12.27.188:42949 requested a full tablet report, sending...
I20260929 22:45:42.814611 19303 ts_manager.cc:194] Registered new tserver with Master: fcd3442e107e4d93add22e46a1ba14d9 (127.12.27.130:38653)
W20260929 22:45:42.894039 19635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:45:42.894265 19635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:45:42.894302 19635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:45:42.895443 19635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:45:42.895509 19635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:45:42.895555 19635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:45:42.897040 19635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:46763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=33063
--tserver_master_addrs=127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:45:42.897300 19635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:45:42.897528 19635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:45:42.902418 19641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.902480 19640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:45:42.902493 19643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:45:42.902513 19635 server_base.cc:1034] running on GCE node
I20260929 22:45:42.902866 19635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:45:42.903095 19635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:45:42.904232 19635 hybrid_clock.cc:648] HybridClock initialized: now 1790721942904221 us; error 27 us; skew 500 ppm
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:45:42.906672 19635 init.cc:377] Logged in from keytab as oryx/127.12.27.131@KRBTEST.COM (short username oryx)
I20260929 22:45:42.907040 19635 webserver.cc:460] Webserver started at http://127.12.27.131:33063/ using document root <none> and password file <none>
I20260929 22:45:42.907207 19635 fs_manager.cc:359] Metadata directory not provided
I20260929 22:45:42.907255 19635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:45:42.908599 19635 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:45:42.909111 19650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.909281 19635 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:45:42.909381 19635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "099d2a136ade45b6a57e16564d7c8d52"
format_stamp: "Formatted at 2026-09-29 22:45:41 on dist-test-slave-00d6"
server_key: "d38acb5bc4718fd5816ca95f63c10d73"
server_key_iv: "b2294337698c9ecc6c1bf0535fb1de76"
server_key_version: "encryptionkey@0"
I20260929 22:45:42.909696 19635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:45:42.921967 19635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:45:42.923748 19635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:45:42.923894 19635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:45:42.924116 19635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:45:42.924414 19635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:45:42.924471 19635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.924511 19635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:45:42.924537 19635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:45:42.930236 19635 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:46763
I20260929 22:45:42.930284 19763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:46763 every 8 connection(s)
I20260929 22:45:42.930603 19635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:45:42.936048 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 19635
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.188@KRBTEST.COM
Sep 29 22:45:42 dist-test-slave-00d6 krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721942, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.189@KRBTEST.COM
I20260929 22:45:42.943306 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.931310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:38571)
0929 22:45:42.931504 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.931550 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.932194 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.932542 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.932547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.933101 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.933256 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.933261 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.934185 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.934186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.935211 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.935213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.935728 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.935862 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.936447 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.936457 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.938277 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.941329 (+ 3052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.941330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.941330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.942052 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.942241 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.942242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.942242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.942293 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.942882 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.942882 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.942947 (+ 65us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.943021 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.943096 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":7,"spinlock_wait_cycles":384,"thread_start_us":87,"threads_started":1}
I20260929 22:45:42.943538 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.931701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:49067 (local address 127.12.27.189:45819)
0929 22:45:42.931751 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.931753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.931764 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:45:42.932324 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.932326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.932338 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.932371 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.933362 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.934116 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.936649 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.936933 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.936988 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.939533 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.939535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.939535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.939543 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.941225 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.941897 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.941899 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.941899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.941964 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.942367 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.942368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.942368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.942509 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.942571 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.943360 (+ 789us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.943451 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:45:42.943306 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.931310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45819 (local address 127.12.27.131:49067)
0929 22:45:42.931504 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.931550 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.932194 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.932552 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.932553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.933114 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.933256 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.933261 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.935312 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.936004 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.936006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.937072 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.937073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.937142 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.937567 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.937571 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.939434 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.941319 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.941327 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.941329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.941836 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.942034 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.942035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.942035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.942166 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.942598 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.942605 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.942767 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.942875 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.943056 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":19,"spinlock_wait_cycles":7040,"thread_start_us":95,"threads_started":1}
I20260929 22:45:42.943692 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.931297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:38571 (local address 127.12.27.190:43113)
0929 22:45:42.931343 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.931345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.931700 (+ 355us) server_negotiation.cc:407] Connection header received
0929 22:45:42.932323 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.932324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.932338 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.932371 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.933362 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.934109 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935303 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.935611 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935698 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.938388 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.938390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.938390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.938398 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.941255 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.942122 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.942123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.942124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.942174 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.942362 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.942363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.942363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.942790 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.942855 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.943486 (+ 631us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.943571 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:45:42.944208 19766 heartbeater.cc:347] Connected to a master server at 127.12.27.189:45819
I20260929 22:45:42.944303 19766 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.944502 19766 heartbeater.cc:511] Master 127.12.27.189:45819 requested a full tablet report, sending...
I20260929 22:45:42.944922 19117 ts_manager.cc:194] Registered new tserver with Master: 099d2a136ade45b6a57e16564d7c8d52 (127.12.27.131:46763)
I20260929 22:45:42.945014 19765 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43113
I20260929 22:45:42.945055 19765 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.945116 19765 heartbeater.cc:511] Master 127.12.27.190:43113 requested a full tablet report, sending...
I20260929 22:45:42.945125 19498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.931719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:53331 (local address 127.12.27.188:42949)
0929 22:45:42.931760 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.931762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.931969 (+ 207us) server_negotiation.cc:407] Connection header received
0929 22:45:42.932329 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.932330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.932342 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.932372 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.933350 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.933847 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935303 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.935611 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935717 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.939590 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.939591 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.939591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.939599 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.941409 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.942243 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.942244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.942244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.942296 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.944196 (+ 1900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.944197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.944198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.944342 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.944411 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.944957 (+ 546us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.945035 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:45:42.945329 19770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.931631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:42949 (local address 127.12.27.131:53331)
0929 22:45:42.931881 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.931891 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.932212 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.932805 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.932806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.933070 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:45:42.933255 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.933259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.933953 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.933954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.935211 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.935213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.935771 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.935772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.935867 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.936602 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:45:42.936607 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:45:42.939481 (+ 2874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:45:42.941497 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.941498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.941499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.941967 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.944074 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:45:42.944075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:45:42.944075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:45:42.944141 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:45:42.944441 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:45:42.944442 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:45:42.944530 (+ 88us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.944600 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.945230 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":6,"thread_start_us":206,"threads_started":1}
I20260929 22:45:42.945336 18520 ts_manager.cc:194] Re-registered known tserver with Master: 099d2a136ade45b6a57e16564d7c8d52 (127.12.27.131:46763)
I20260929 22:45:42.945705 18520 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:38571
I20260929 22:45:42.945883 19764 heartbeater.cc:347] Connected to a master server at 127.12.27.188:42949
I20260929 22:45:42.945948 19764 heartbeater.cc:464] Registering TS with master...
I20260929 22:45:42.946018 19764 heartbeater.cc:511] Master 127.12.27.188:42949 requested a full tablet report, sending...
I20260929 22:45:42.946277 19303 ts_manager.cc:194] Registered new tserver with Master: 099d2a136ade45b6a57e16564d7c8d52 (127.12.27.131:46763)
I20260929 22:45:42.950374 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.937576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57616 (local address 127.12.27.188:42949)
0929 22:45:42.937684 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.937685 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.938682 (+ 997us) server_negotiation.cc:407] Connection header received
0929 22:45:42.938906 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.938907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.938922 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.938982 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.939893 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.940642 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.941744 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.942070 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.942109 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.947048 (+ 4939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.947049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.947050 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.947056 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.948889 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.949554 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.949555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.949555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.949639 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.949855 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.949856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.949856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.949983 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.950070 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.950175 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.950261 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
I20260929 22:45:42.950802 19780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.939103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54404 (local address 127.12.27.189:45819)
0929 22:45:42.940104 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.940105 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.940112 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:42.940160 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.940161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.940170 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.940225 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.942164 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.942986 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.944114 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.944391 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.944451 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.946918 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.946919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.946919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.946925 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.949080 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.949472 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.949473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.949474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.949531 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.949737 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.949738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.949739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.949890 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.950001 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.950626 (+ 625us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.950711 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":981,"thread_start_us":46,"threads_started":1}
I20260929 22:45:42.951756 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.938960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37980 (local address 127.12.27.190:43113)
0929 22:45:42.939919 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.939921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.939928 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:42.939946 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.939947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.939959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.940037 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:42.944738 (+ 4701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.946452 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.947461 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.947828 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.947909 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.949020 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:42.949022 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:42.949022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:42.949029 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:42.950788 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.951135 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.951136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.951136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.951200 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:42.951336 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:42.951336 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:42.951336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:42.951420 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:42.951489 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.951552 (+ 63us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.951610 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":927,"thread_start_us":95,"threads_started":1}
I20260929 22:45:42.953136 18520 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:45:42.954662 18520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:45:42.962528 19786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.958709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:46763 (local address 127.0.0.1:43414)
0929 22:45:42.958840 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.958849 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.958891 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.959470 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.959471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.959474 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:42.959512 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.959514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.960670 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.960671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.961423 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.961425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.962244 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.962245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.962305 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.962310 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.962364 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.962406 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":91,"threads_started":1}
I20260929 22:45:42.962646 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.958594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45159 (local address 127.0.0.1:49370)
0929 22:45:42.958672 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.958683 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.958722 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.959058 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.959059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.959060 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:42.959108 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.959109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.960479 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.960480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.961559 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.961561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.962371 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.962372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.962449 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.962453 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.962514 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.962555 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":3}
I20260929 22:45:42.962661 19785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.958689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49370 (local address 127.12.27.129:45159)
0929 22:45:42.958876 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.958882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.958892 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:45:42.958934 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.958936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.958953 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.959243 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:42.959299 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.960407 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.961645 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.962299 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.962373 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.962445 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.962529 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.962578 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20260929 22:45:42.962921 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.958629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38653 (local address 127.0.0.1:46720)
0929 22:45:42.958735 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.958746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.958795 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.959241 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.959242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.959244 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:42.959292 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.959293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.960382 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.960383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.961834 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.961837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.962703 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.962704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:42.962761 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.962765 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:45:42.962799 (+ 34us) client_negotiation.cc:240] Negotiation successful
0929 22:45:42.962844 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":297}
I20260929 22:45:42.963408 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.958911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.12.27.131:46763)
0929 22:45:42.959337 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.959340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.959349 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:42.959382 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.959383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.959398 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.959473 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:42.959571 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.960592 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.961512 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.962154 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.962228 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.962298 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.963267 (+ 969us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.963319 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":86,"threads_started":1}
I20260929 22:45:42.963423 19787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.958890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46720 (local address 127.12.27.130:38653)
0929 22:45:42.959067 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.959070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.959079 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:45:42.959116 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.959118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.959133 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.959223 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:42.959381 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.960292 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.961912 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.962610 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.963196 (+ 586us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:42.963282 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:42.963304 (+ 22us) server_negotiation.cc:299] Negotiation successful
0929 22:45:42.963341 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260929 22:45:42.963570 19425 tablet_service.cc:1467] Processing CreateTablet for tablet ff9c1e37387c4b69a95cdd5225ef5860 (DEFAULT_TABLE table=test-table [id=87b3f3cba31b49f3a0553967c004cdb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:42.963979 19425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9c1e37387c4b69a95cdd5225ef5860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:42.964020 19698 tablet_service.cc:1467] Processing CreateTablet for tablet ff9c1e37387c4b69a95cdd5225ef5860 (DEFAULT_TABLE table=test-table [id=87b3f3cba31b49f3a0553967c004cdb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:42.964018 19562 tablet_service.cc:1467] Processing CreateTablet for tablet ff9c1e37387c4b69a95cdd5225ef5860 (DEFAULT_TABLE table=test-table [id=87b3f3cba31b49f3a0553967c004cdb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:45:42.964331 19562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9c1e37387c4b69a95cdd5225ef5860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:42.964332 19698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff9c1e37387c4b69a95cdd5225ef5860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:45:42.966706 19789 tablet_bootstrap.cc:492] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Bootstrap starting.
I20260929 22:45:42.967236 19789 tablet_bootstrap.cc:654] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:42.967605 19791 tablet_bootstrap.cc:492] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Bootstrap starting.
I20260929 22:45:42.967597 19789 log.cc:824] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:42.967962 19790 tablet_bootstrap.cc:492] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Bootstrap starting.
I20260929 22:45:42.968371 19789 tablet_bootstrap.cc:492] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: No bootstrap required, opened a new log
I20260929 22:45:42.968393 19791 tablet_bootstrap.cc:654] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:42.968427 19789 ts_tablet_manager.cc:1397] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:45:42.968546 19790 tablet_bootstrap.cc:654] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Neither blocks nor log segments found. Creating new log.
I20260929 22:45:42.968776 19791 log.cc:824] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:42.968892 19790 log.cc:824] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Log is configured to *not* fsync() on all Append() calls
I20260929 22:45:42.969595 19790 tablet_bootstrap.cc:492] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: No bootstrap required, opened a new log
I20260929 22:45:42.969595 19791 tablet_bootstrap.cc:492] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: No bootstrap required, opened a new log
I20260929 22:45:42.969662 19790 ts_tablet_manager.cc:1397] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:45:42.969662 19791 ts_tablet_manager.cc:1397] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:45:42.970566 19789 raft_consensus.cc:348] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.970718 19789 raft_consensus.cc:374] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:42.970754 19789 raft_consensus.cc:729] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4af1f213f2724ac6a9db58b773c97b96, State: Initialized, Role: FOLLOWER
I20260929 22:45:42.970890 19789 consensus_queue.cc:260] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.971166 19789 ts_tablet_manager.cc:1428] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:45:42.971275 19492 heartbeater.cc:503] Master 127.12.27.190:43113 was elected leader, sending a full tablet report...
I20260929 22:45:42.972115 19790 raft_consensus.cc:348] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.972151 19791 raft_consensus.cc:348] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.972266 19790 raft_consensus.cc:374] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:42.972266 19791 raft_consensus.cc:374] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:45:42.972307 19790 raft_consensus.cc:729] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099d2a136ade45b6a57e16564d7c8d52, State: Initialized, Role: FOLLOWER
I20260929 22:45:42.972307 19791 raft_consensus.cc:729] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd3442e107e4d93add22e46a1ba14d9, State: Initialized, Role: FOLLOWER
I20260929 22:45:42.972412 19791 consensus_queue.cc:260] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.972432 19790 consensus_queue.cc:260] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.972661 19790 ts_tablet_manager.cc:1428] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:45:42.972661 19791 ts_tablet_manager.cc:1428] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 22:45:42.972764 19629 heartbeater.cc:503] Master 127.12.27.190:43113 was elected leader, sending a full tablet report...
I20260929 22:45:42.973084 19765 heartbeater.cc:503] Master 127.12.27.190:43113 was elected leader, sending a full tablet report...
I20260929 22:45:42.998214 19795 raft_consensus.cc:482] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:45:42.998322 19795 raft_consensus.cc:504] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:42.998620 19795 leader_election.cc:288] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd3442e107e4d93add22e46a1ba14d9 (127.12.27.130:38653), 099d2a136ade45b6a57e16564d7c8d52 (127.12.27.131:46763)
I20260929 22:45:43.001384 19787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.998891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:39609 (local address 127.12.27.130:38653)
0929 22:45:42.998955 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.998958 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.998966 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:45:42.998992 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.998994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.999004 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.999051 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:42.999206 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.999767 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.000687 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.001048 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.001132 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.001141 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:43.001277 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 22:45:43.001312 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:45:43.001384 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.998795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38653 (local address 127.12.27.129:39609)
0929 22:45:42.998833 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.998845 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.998887 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.999064 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.999065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.999066 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:42.999133 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.999135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.999844 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.999845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:43.000596 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:43.000598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.001129 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.001130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:43.001199 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.001202 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:43.001272 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:45:43.001315 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260929 22:45:43.001474 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.998881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:43701 (local address 127.12.27.131:46763)
0929 22:45:42.998944 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:42.998947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:42.999060 (+ 113us) server_negotiation.cc:407] Connection header received
0929 22:45:42.999128 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:42.999129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:42.999138 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:42.999209 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:45:42.999357 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.999883 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.000747 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.001109 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.001203 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.001211 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:43.001369 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:45:43.001407 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:45:43.001506 19497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:42.998795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:46763 (local address 127.12.27.129:43701)
0929 22:45:42.999000 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:42.999008 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:45:42.999075 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:45:42.999211 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:45:42.999211 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:45:42.999213 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:45:42.999274 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:42.999276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:42.999956 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:42.999957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:43.000658 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:45:43.000659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.001203 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.001204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:45:43.001290 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.001293 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:45:43.001351 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:45:43.001392 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":172}
I20260929 22:45:43.001760 19582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9c1e37387c4b69a95cdd5225ef5860" candidate_uuid: "4af1f213f2724ac6a9db58b773c97b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd3442e107e4d93add22e46a1ba14d9" is_pre_election: true
I20260929 22:45:43.001904 19582 raft_consensus.cc:2454] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4af1f213f2724ac6a9db58b773c97b96 in term 0.
I20260929 22:45:43.001952 19718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9c1e37387c4b69a95cdd5225ef5860" candidate_uuid: "4af1f213f2724ac6a9db58b773c97b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099d2a136ade45b6a57e16564d7c8d52" is_pre_election: true
I20260929 22:45:43.002107 19718 raft_consensus.cc:2454] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4af1f213f2724ac6a9db58b773c97b96 in term 0.
I20260929 22:45:43.002121 19381 leader_election.cc:302] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4af1f213f2724ac6a9db58b773c97b96, fcd3442e107e4d93add22e46a1ba14d9; no voters:
I20260929 22:45:43.002262 19795 raft_consensus.cc:2781] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:45:43.002326 19795 raft_consensus.cc:482] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:45:43.002350 19795 raft_consensus.cc:3037] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:43.003046 19795 raft_consensus.cc:504] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:43.003181 19795 leader_election.cc:288] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [CANDIDATE]: Term 1 election: Requested vote from peers fcd3442e107e4d93add22e46a1ba14d9 (127.12.27.130:38653), 099d2a136ade45b6a57e16564d7c8d52 (127.12.27.131:46763)
I20260929 22:45:43.003341 19718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9c1e37387c4b69a95cdd5225ef5860" candidate_uuid: "4af1f213f2724ac6a9db58b773c97b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099d2a136ade45b6a57e16564d7c8d52"
I20260929 22:45:43.003417 19718 raft_consensus.cc:3037] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:43.004137 19718 raft_consensus.cc:2454] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4af1f213f2724ac6a9db58b773c97b96 in term 1.
I20260929 22:45:43.004261 19582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff9c1e37387c4b69a95cdd5225ef5860" candidate_uuid: "4af1f213f2724ac6a9db58b773c97b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd3442e107e4d93add22e46a1ba14d9"
I20260929 22:45:43.004369 19582 raft_consensus.cc:3037] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:45:43.004459 19380 leader_election.cc:302] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099d2a136ade45b6a57e16564d7c8d52, 4af1f213f2724ac6a9db58b773c97b96; no voters:
I20260929 22:45:43.004594 19795 raft_consensus.cc:2781] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:45:43.004776 19795 raft_consensus.cc:686] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 1 LEADER]: Becoming Leader. State: Replica: 4af1f213f2724ac6a9db58b773c97b96, State: Running, Role: LEADER
I20260929 22:45:43.004881 19795 consensus_queue.cc:237] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } }
I20260929 22:45:43.005280 19582 raft_consensus.cc:2454] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4af1f213f2724ac6a9db58b773c97b96 in term 1.
I20260929 22:45:43.005842 18520 catalog_manager.cc:5495] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4af1f213f2724ac6a9db58b773c97b96 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "4af1f213f2724ac6a9db58b773c97b96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4af1f213f2724ac6a9db58b773c97b96" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 } health_report { overall_health: UNKNOWN } } }
I20260929 22:45:43.011543 19785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:43.009441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49378 (local address 127.12.27.129:45159)
0929 22:45:43.009500 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:43.009502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:43.009509 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:45:43.009536 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:43.009537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:43.009551 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:43.009602 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:45:43.009693 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.010194 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.010865 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.011038 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.011087 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.011223 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:45:43.011322 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:45:43.011383 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:43.011417 (+ 34us) server_negotiation.cc:299] Negotiation successful
0929 22:45:43.011433 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:45:43.013257 19718 raft_consensus.cc:1261] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 1 FOLLOWER]: Refusing update from remote peer 4af1f213f2724ac6a9db58b773c97b96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:43.013543 19582 raft_consensus.cc:1261] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 1 FOLLOWER]: Refusing update from remote peer 4af1f213f2724ac6a9db58b773c97b96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:45:43.013603 19798 consensus_queue.cc:1035] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099d2a136ade45b6a57e16564d7c8d52" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 46763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:43.013810 19798 consensus_queue.cc:1035] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd3442e107e4d93add22e46a1ba14d9" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:45:43.017092 19803 mvcc.cc:205] Tried to move back new op lower bound from 7334797078579957760 to 7334797078548721664. Current Snapshot: MvccSnapshot[applied={T|T < 7334797078579957760}]
I20260929 22:45:43.018630 18520 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:43.018712 18520 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:45:43.018756 19801 mvcc.cc:205] Tried to move back new op lower bound from 7334797078579957760 to 7334797078548721664. Current Snapshot: MvccSnapshot[applied={T|T < 7334797078579957760 or (T in {7334797078579957760})}]
I20260929 22:45:43.019794 19802 mvcc.cc:205] Tried to move back new op lower bound from 7334797078579957760 to 7334797078548721664. Current Snapshot: MvccSnapshot[applied={T|T < 7334797078579957760}]
I20260929 22:45:43.020457 18520 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9cfd7779b4bd4893a126d3dc56545683: Sending DeleteTablet for 3 replicas of tablet ff9c1e37387c4b69a95cdd5225ef5860
I20260929 22:45:43.020772 19562 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9c1e37387c4b69a95cdd5225ef5860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:43 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:46720
I20260929 22:45:43.020872 19425 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9c1e37387c4b69a95cdd5225ef5860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:43 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49370
I20260929 22:45:43.021019 19810 tablet_replica.cc:330] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: stopping tablet replica
I20260929 22:45:43.021065 19698 tablet_service.cc:1514] Processing DeleteTablet for tablet ff9c1e37387c4b69a95cdd5225ef5860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:45:43 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:43414
I20260929 22:45:43.021109 19810 raft_consensus.cc:2229] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:43.021195 19810 raft_consensus.cc:2258] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:43.021306 19812 tablet_replica.cc:330] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: stopping tablet replica
I20260929 22:45:43.021432 19812 raft_consensus.cc:2229] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:45:43.021570 19812 raft_consensus.cc:2258] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:43.021652 19810 ts_tablet_manager.cc:1905] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:43.022580 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18488
I20260929 22:45:43.023268 19810 ts_tablet_manager.cc:1918] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:43.023355 19810 log.cc:1196] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/ff9c1e37387c4b69a95cdd5225ef5860
I20260929 22:45:43.023608 19810 ts_tablet_manager.cc:1939] T ff9c1e37387c4b69a95cdd5225ef5860 P fcd3442e107e4d93add22e46a1ba14d9: Deleting consensus metadata
I20260929 22:45:43.027912 19812 ts_tablet_manager.cc:1905] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:45:43.028275 19518 connection.cc:535] server connection from 127.0.0.1:46720 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:45:43.029851 19812 ts_tablet_manager.cc:1918] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:43.029920 19812 log.cc:1196] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/ff9c1e37387c4b69a95cdd5225ef5860
I20260929 22:45:43.030170 19812 ts_tablet_manager.cc:1939] T ff9c1e37387c4b69a95cdd5225ef5860 P 099d2a136ade45b6a57e16564d7c8d52: Deleting consensus metadata
W20260929 22:45:43.030598 19653 connection.cc:441] server connection from 127.0.0.1:43414 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43414 (request call id 1) could send its response
I20260929 22:45:43.031581 19811 tablet_replica.cc:330] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: stopping tablet replica
I20260929 22:45:43.031754 19811 raft_consensus.cc:2229] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:45:43.031903 19811 raft_consensus.cc:2258] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:45:43.036010 19811 ts_tablet_manager.cc:1905] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:45:43.037873 19811 ts_tablet_manager.cc:1918] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:45:43.038000 19811 log.cc:1196] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/ff9c1e37387c4b69a95cdd5225ef5860
I20260929 22:45:43.038347 19811 ts_tablet_manager.cc:1939] T ff9c1e37387c4b69a95cdd5225ef5860 P 4af1f213f2724ac6a9db58b773c97b96: Deleting consensus metadata
I20260929 22:45:43.038602 19780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:43.029709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54414 (local address 127.12.27.189:45819)
0929 22:45:43.029749 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:43.029751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:43.030342 (+ 591us) server_negotiation.cc:407] Connection header received
0929 22:45:43.030436 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:43.030437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:43.030450 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:43.030479 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:43.031178 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.031881 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.033016 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.033313 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.033350 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.034700 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:43.034701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:43.034702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:43.034708 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:43.036747 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:43.037702 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:43.037703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:43.037704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:43.037763 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:43.037995 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:43.037996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:43.037997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:43.038136 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:43.038209 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:43.038426 (+ 217us) server_negotiation.cc:299] Negotiation successful
0929 22:45:43.038518 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:45:43.038972 19379 connection.cc:441] server connection from 127.0.0.1:49370 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49370 (request call id 1) could send its response
I20260929 22:45:43.039544 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:43.021781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57618 (local address 127.12.27.188:42949)
0929 22:45:43.021935 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:43.021938 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:43.028549 (+ 6611us) server_negotiation.cc:407] Connection header received
0929 22:45:43.028700 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:43.028701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:43.028720 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:43.028751 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:43.029560 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.030303 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.031514 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.031855 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.031924 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.033484 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:43.033486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:43.033486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:43.033493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:43.035448 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:43.036838 (+ 1390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:43.036839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:43.036840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:43.036886 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:43.037410 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:43.037411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:43.037411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:43.037543 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:43.037612 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:43.039340 (+ 1728us) server_negotiation.cc:299] Negotiation successful
0929 22:45:43.039409 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260929 22:45:43.039690 19498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:43.030030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57630 (local address 127.12.27.188:42949)
0929 22:45:43.030064 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:45:43.030066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:45:43.032151 (+ 2085us) server_negotiation.cc:407] Connection header received
0929 22:45:43.032240 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:45:43.032241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:45:43.032250 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:45:43.032277 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:45:43.032965 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.033637 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.034700 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:45:43.034995 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:45:43.035036 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:45:43.036568 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:45:43.036569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:45:43.036570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:45:43.036576 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:45:43.038267 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:43.038642 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:43.038643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:43.038643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:43.038690 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:45:43.038869 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:45:43.038870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:45:43.038870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:45:43.038977 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:45:43.039041 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:45:43.039514 (+ 473us) server_negotiation.cc:299] Negotiation successful
0929 22:45:43.039585 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:45:44.018203 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:44.017877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:53519)
0929 22:45:44.018045 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:44.018136 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":83,"threads_started":1}
W20260929 22:45:44.018445 19629 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:43113 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:44.021245 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:44.021037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:45513)
0929 22:45:44.021139 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:44.021207 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":64,"threads_started":1}
W20260929 22:45:44.021569 19492 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:43113 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:44.021625 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:44.021445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:33209)
0929 22:45:44.021537 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:44.021592 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":43,"threads_started":1}
W20260929 22:45:44.021787 19765 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:43113 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:44.521060 19824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfd7779b4bd4893a126d3dc56545683)
I20260929 22:45:44.521246 19824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:44.521528 19824 leader_election.cc:288] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113)
I20260929 22:45:44.521839 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:44.521631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:38430)
0929 22:45:44.521743 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:44.521804 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":51,"threads_started":1}
W20260929 22:45:44.522035 19103 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:44.522442 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:44.522333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:38446)
0929 22:45:44.522399 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:44.522425 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260929 22:45:44.522564 19103 leader_election.cc:334] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113): Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:44.522624 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d87286f7c034beaab192a63d46fba75; no voters: 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:45:44.522735 19824 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:45:45.019052 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:45.018806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:58793)
0929 22:45:45.018951 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:45.019009 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":56,"threads_started":1}
I20260929 22:45:45.022302 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:45.022125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:51727)
0929 22:45:45.022233 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:45.022268 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":51,"threads_started":1}
I20260929 22:45:45.022300 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:45.021975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:44787)
0929 22:45:45.022228 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:45.022259 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":93,"threads_started":1}
I20260929 22:45:46.019886 19830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:46.019598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:37053)
0929 22:45:46.019754 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:46.019823 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":104,"threads_started":1}
I20260929 22:45:46.022908 19832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:46.022723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:54999)
0929 22:45:46.022829 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:46.022868 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":65,"threads_started":1}
I20260929 22:45:46.022914 19831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:46.022702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:44997)
0929 22:45:46.022827 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:46.022867 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260929 22:45:46.099536 19833 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfd7779b4bd4893a126d3dc56545683)
I20260929 22:45:46.099649 19833 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:46.099838 19833 leader_election.cc:288] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113)
I20260929 22:45:46.100247 19834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:46.100026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:38698)
0929 22:45:46.100164 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:46.100210 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260929 22:45:46.100675 19834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:46.100576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:38702)
0929 22:45:46.100626 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:46.100652 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:45:46.100760 19103 leader_election.cc:334] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113): Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:46.100803 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d87286f7c034beaab192a63d46fba75; no voters: 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:45:46.100872 19833 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:45:47.020722 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:47.020460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:34323)
0929 22:45:47.020623 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:47.020665 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260929 22:45:47.023577 19837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:47.023290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:46261)
0929 22:45:47.023481 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:47.023525 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":70,"threads_started":1}
I20260929 22:45:47.023586 19838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:47.023339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:59537)
0929 22:45:47.023515 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:47.023549 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
I20260929 22:45:48.021493 19839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:48.021201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:48811)
0929 22:45:48.021352 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:48.021426 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260929 22:45:48.024166 19840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:48.023958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:37999)
0929 22:45:48.024052 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:48.024115 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":46,"threads_started":1}
I20260929 22:45:48.024353 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:48.024073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:37085)
0929 22:45:48.024269 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:48.024306 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":69,"threads_started":1}
I20260929 22:45:48.932106 19842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfd7779b4bd4893a126d3dc56545683)
I20260929 22:45:48.932190 19842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:48.932303 19842 leader_election.cc:288] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113)
I20260929 22:45:48.932669 19843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:48.932472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:52892)
0929 22:45:48.932586 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:48.932633 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":72,"threads_started":1}
I20260929 22:45:48.933144 19843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:48.933044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:52904)
0929 22:45:48.933096 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:48.933125 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 22:45:48.933228 19103 leader_election.cc:334] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113): Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:48.933305 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d87286f7c034beaab192a63d46fba75; no voters: 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:45:48.933387 19842 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:45:49.022302 19845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:49.022022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:33823)
0929 22:45:49.022183 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:49.022242 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260929 22:45:49.024802 19846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:49.024610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:59147)
0929 22:45:49.024723 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:49.024764 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260929 22:45:49.024989 19847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:49.024721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:52075)
0929 22:45:49.024893 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:49.024947 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":75,"threads_started":1}
I20260929 22:45:50.023028 19848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:50.022768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:54193)
0929 22:45:50.022903 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:50.022968 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260929 22:45:50.025547 19850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:50.025368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:52697)
0929 22:45:50.025480 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:50.025509 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":74,"threads_started":1}
I20260929 22:45:50.025547 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:50.025357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:42487)
0929 22:45:50.025467 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:50.025509 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":46,"threads_started":1}
I20260929 22:45:51.023763 19851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:51.023468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:34597)
0929 22:45:51.023648 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:51.023694 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260929 22:45:51.026154 19852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:51.025942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:50423)
0929 22:45:51.026072 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:51.026106 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":52,"threads_started":1}
I20260929 22:45:51.026237 19853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:51.026031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:57525)
0929 22:45:51.026142 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:51.026175 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":54,"threads_started":1}
I20260929 22:45:52.024933 19854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:52.024305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:41421)
0929 22:45:52.024804 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:52.024869 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":66,"threads_started":1}
I20260929 22:45:52.026800 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:52.026582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:56679)
0929 22:45:52.026712 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:52.026753 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":60,"threads_started":1}
I20260929 22:45:52.026962 19856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:52.026704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:34249)
0929 22:45:52.026816 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:52.026907 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":54,"threads_started":1}
I20260929 22:45:53.025820 19857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:53.025591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:50473)
0929 22:45:53.025724 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:53.025774 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260929 22:45:53.027407 19858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:53.027168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:41685)
0929 22:45:53.027320 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:53.027362 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":58,"threads_started":1}
I20260929 22:45:53.027671 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:53.027435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:40929)
0929 22:45:53.027574 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:53.027598 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260929 22:45:53.811818 19860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfd7779b4bd4893a126d3dc56545683)
I20260929 22:45:53.811911 19860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:53.812036 19860 leader_election.cc:288] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113)
I20260929 22:45:53.812407 19861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:53.812220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:53224)
0929 22:45:53.812323 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:53.812370 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":60,"threads_started":1}
W20260929 22:45:53.812498 19103 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260929 22:45:53.812937 19861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:53.812767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:53234)
0929 22:45:53.812875 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:53.812912 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260929 22:45:53.813021 19103 leader_election.cc:334] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113): Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:53.813099 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d87286f7c034beaab192a63d46fba75; no voters: 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:45:53.813201 19860 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:45:54.026821 19863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:54.026588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:49709)
0929 22:45:54.026731 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:54.026778 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260929 22:45:54.028035 19864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:54.027830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:43911)
0929 22:45:54.027970 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:54.027999 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260929 22:45:54.028282 19865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:54.028033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:37469)
0929 22:45:54.028182 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:54.028221 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260929 22:45:55.027611 19866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:55.027399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:46691)
0929 22:45:55.027525 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:55.027566 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260929 22:45:55.028570 19867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:55.028372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:40163)
0929 22:45:55.028477 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:55.028513 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":70,"threads_started":1}
I20260929 22:45:55.028855 19868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:55.028669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:59081)
0929 22:45:55.028777 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:55.028813 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":49,"threads_started":1}
I20260929 22:45:56.028373 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:56.028081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:60897)
0929 22:45:56.028233 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:56.028274 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
I20260929 22:45:56.029263 19870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:56.029029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:57775)
0929 22:45:56.029153 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:56.029196 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260929 22:45:56.029479 19871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:56.029242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:43025)
0929 22:45:56.029350 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:56.029389 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71,"thread_start_us":38,"threads_started":1}
I20260929 22:45:57.029152 19872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:57.028778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:35069)
0929 22:45:57.029023 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:57.029097 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":122,"threads_started":1}
I20260929 22:45:57.029835 19873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:57.029635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:41385)
0929 22:45:57.029749 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:57.029788 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":53,"threads_started":1}
I20260929 22:45:57.030110 19874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:57.029950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:42947)
0929 22:45:57.030048 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:57.030078 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":53,"threads_started":1}
I20260929 22:45:58.029892 19875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:58.029621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:44465)
0929 22:45:58.029780 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:58.029831 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260929 22:45:58.030475 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:58.030260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:40965)
0929 22:45:58.030385 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:58.030415 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
I20260929 22:45:58.030691 19877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:58.030507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:39053)
0929 22:45:58.030631 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:58.030660 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":81,"threads_started":1}
I20260929 22:45:58.273680 19878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfd7779b4bd4893a126d3dc56545683)
I20260929 22:45:58.273998 19878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:45:58.274255 19878 leader_election.cc:288] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113)
I20260929 22:45:58.274638 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:58.274415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:48848)
0929 22:45:58.274544 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:58.274596 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260929 22:45:58.275269 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:58.275141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:48864)
0929 22:45:58.275216 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:58.275249 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260929 22:45:58.275458 19103 leader_election.cc:334] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113): Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:45:58.275532 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d87286f7c034beaab192a63d46fba75; no voters: 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:45:58.275617 19878 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:45:59.030558 19881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:59.030343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:47191)
0929 22:45:59.030455 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:59.030499 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":68,"threads_started":1}
I20260929 22:45:59.031059 19882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:59.030811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:43339)
0929 22:45:59.030977 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:59.031018 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":52,"threads_started":1}
I20260929 22:45:59.031309 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:45:59.031067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:58201)
0929 22:45:59.031217 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:45:59.031255 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
I20260929 22:46:00.031303 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:00.031031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:32781)
0929 22:46:00.031177 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:00.031226 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
I20260929 22:46:00.031759 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:00.031546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:49657)
0929 22:46:00.031688 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:00.031724 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260929 22:46:00.031885 19886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:00.031704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:34103)
0929 22:46:00.031795 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:00.031842 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":41,"threads_started":1}
I20260929 22:46:01.032200 19887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:01.031952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:48803)
0929 22:46:01.032092 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:01.032136 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260929 22:46:01.032363 19888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:01.032105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:57945)
0929 22:46:01.032267 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:01.032309 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":68,"threads_started":1}
I20260929 22:46:01.032467 19889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:01.032209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:36569)
0929 22:46:01.032388 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:01.032422 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":47,"threads_started":1}
I20260929 22:46:02.032938 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:02.032656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:55865)
0929 22:46:02.032823 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:02.032870 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":69,"threads_started":1}
I20260929 22:46:02.033141 19891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:02.032839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:40231)
0929 22:46:02.033058 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:02.033096 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":75,"threads_started":1}
I20260929 22:46:02.033141 19892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:02.032938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:55487)
0929 22:46:02.033075 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:02.033101 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":46,"threads_started":1}
I20260929 22:46:03.033782 19893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:03.033532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:41187)
0929 22:46:03.033683 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:03.033727 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260929 22:46:03.033814 19895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:03.033655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:41343)
0929 22:46:03.033746 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:03.033770 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":40,"threads_started":1}
I20260929 22:46:03.033829 19894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:03.033596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:54435)
0929 22:46:03.033730 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:03.033767 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260929 22:46:04.034725 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:04.034358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:46931)
0929 22:46:04.034641 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:04.034672 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":80,"threads_started":1}
I20260929 22:46:04.034725 19896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:04.034366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:33049)
0929 22:46:04.034629 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:04.034672 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":65,"threads_started":1}
I20260929 22:46:04.034767 19898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:04.034476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:50165)
0929 22:46:04.034646 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:04.034714 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":48,"threads_started":1}
I20260929 22:46:05.035359 19899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:05.035124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:36735)
0929 22:46:05.035251 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:05.035300 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260929 22:46:05.035393 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:05.035149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:50327)
0929 22:46:05.035312 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:05.035347 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":53,"threads_started":1}
I20260929 22:46:05.035393 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:05.035228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:55631)
0929 22:46:05.035318 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:05.035346 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":43,"threads_started":1}
I20260929 22:46:06.036051 19903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:06.035833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:57879)
0929 22:46:06.035947 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:06.035990 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":41,"threads_started":1}
I20260929 22:46:06.036130 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:06.035764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:58549)
0929 22:46:06.036043 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:06.036078 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":65,"threads_started":1}
I20260929 22:46:06.036392 19904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:06.036035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:57747)
0929 22:46:06.036309 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:06.036350 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":53,"threads_started":1}
I20260929 22:46:07.036829 19905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:07.036566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:38243)
0929 22:46:07.036714 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:07.036756 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260929 22:46:07.036883 19906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:07.036566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:57631)
0929 22:46:07.036755 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:07.036800 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":66,"threads_started":1}
I20260929 22:46:07.037071 19907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:07.036821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:50835)
0929 22:46:07.036942 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:07.036972 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
I20260929 22:46:08.037585 19908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:08.037355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:46243)
0929 22:46:08.037487 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:08.037532 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260929 22:46:08.037604 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:08.037433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:43239)
0929 22:46:08.037540 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:08.037568 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":54,"threads_started":1}
I20260929 22:46:08.037590 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:08.037377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:38767)
0929 22:46:08.037495 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:08.037536 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
I20260929 22:46:08.058298 19911 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfd7779b4bd4893a126d3dc56545683)
I20260929 22:46:08.058379 19911 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9cfd7779b4bd4893a126d3dc56545683" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43113 } } peers { permanent_uuid: "3d87286f7c034beaab192a63d46fba75" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45819 } attrs { promote: false } } peers { permanent_uuid: "4d8a1ea70e73407683864bf00c1c69ea" member_type: NON_VOTER last_known_addr { host: "127.12.27.188" port: 42949 } attrs { promote: true } }
I20260929 22:46:08.058503 19911 leader_election.cc:288] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113)
I20260929 22:46:08.058797 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:08.058649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:48116)
0929 22:46:08.058734 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:08.058768 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":43,"threads_started":1}
W20260929 22:46:08.058878 19103 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260929 22:46:08.059213 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:08.059157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.0.0.1:48122)
0929 22:46:08.059179 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:08.059201 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260929 22:46:08.059288 19103 leader_election.cc:334] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfd7779b4bd4893a126d3dc56545683 (127.12.27.190:43113): Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
I20260929 22:46:08.059363 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d87286f7c034beaab192a63d46fba75; no voters: 9cfd7779b4bd4893a126d3dc56545683
I20260929 22:46:08.059456 19911 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d87286f7c034beaab192a63d46fba75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:46:09.038234 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:09.038004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:37699)
0929 22:46:09.038137 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:09.038174 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260929 22:46:09.038229 19914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:09.037982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:52717)
0929 22:46:09.038125 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:09.038175 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260929 22:46:09.038229 19916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:09.038023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:54269)
0929 22:46:09.038151 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:09.038184 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":45,"threads_started":1}
I20260929 22:46:10.038959 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:10.038734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:45679)
0929 22:46:10.038859 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:10.038903 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
I20260929 22:46:10.038983 19918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:10.038773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:40355)
0929 22:46:10.038893 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:10.038936 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260929 22:46:10.039065 19919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:10.038783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:58589)
0929 22:46:10.038989 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:10.039022 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":47,"threads_started":1}
I20260929 22:46:11.039774 19921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:11.039544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:43931)
0929 22:46:11.039686 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:11.039721 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":60,"threads_started":1}
I20260929 22:46:11.039774 19920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:11.039544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:50899)
0929 22:46:11.039686 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:11.039721 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":60,"threads_started":1}
I20260929 22:46:11.039805 19922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:11.039589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:43047)
0929 22:46:11.039722 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:11.039764 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260929 22:46:12.040483 19923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:12.040242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:58701)
0929 22:46:12.040409 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:12.040436 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":67,"threads_started":1}
I20260929 22:46:12.040483 19925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:12.040242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:53903)
0929 22:46:12.040390 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:12.040432 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260929 22:46:12.040535 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:12.040272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:44519)
0929 22:46:12.040467 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:12.040499 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":71,"threads_started":1}
I20260929 22:46:13.041180 19926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:13.040939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.131:43337)
0929 22:46:13.041076 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:13.041123 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260929 22:46:13.041213 19928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:13.041033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.130:42009)
0929 22:46:13.041146 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:13.041172 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":52,"threads_started":1}
I20260929 22:46:13.041229 19927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:13.040980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43113 (local address 127.12.27.129:39111)
0929 22:46:13.041098 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:13.041133 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:43113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":55,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.12.27.190:43113,127.12.27.189:45819,127.12.27.188:42949, num_attempts: 1)
I20260929 22:46:13.218968 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 19264
I20260929 22:46:13.224618 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 19499
I20260929 22:46:13.229128 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 19635
I20260929 22:46:13.233429 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 18984
I20260929 22:46:13.237751 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 19171
2026-09-29T22:46:13Z chronyd exiting
I20260929 22:46:13.253495 12398 test_util.cc:175] -----------------------------------------------
I20260929 22:46:13.253573 12398 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790721915685765-12398-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (33043 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:46:13 dist-test-slave-00d6 krb5kdc[19931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:46:13 dist-test-slave-00d6 krb5kdc[19931](info): set up 2 sockets
Sep 29 22:46:13 dist-test-slave-00d6 krb5kdc[19931](info): commencing operation
krb5kdc: starting...
W20260929 22:46:14.268662 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:46:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:14Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab.
Entry for principal oryx/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab.
I20260929 22:46:14.386366 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:43177
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab
--principal=oryx/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:43177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:14.474856 19944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:14.475049 19944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:14.475071 19944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:14.476322 19944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:14.476364 19944 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 22:46:14.476377 19944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:14.476392 19944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:14.476441 19944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:14.476459 19944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:14.477964 19944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:43177
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.190.keytab
--principal=oryx/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:43177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:14.478207 19944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:14.478446 19944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:46:14.483587 19944 server_base.cc:1034] running on GCE node
W20260929 22:46:14.483543 19950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:14.483530 19949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:14.483559 19952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:14.484103 19944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:14.484360 19944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:14.485512 19944 hybrid_clock.cc:648] HybridClock initialized: now 1790721974485485 us; error 41 us; skew 500 ppm
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:14.488204 19944 init.cc:377] Logged in from keytab as oryx/127.12.27.190@KRBTEST.COM (short username oryx)
I20260929 22:46:14.488574 19944 webserver.cc:460] Webserver started at http://127.12.27.190:38221/ using document root <none> and password file <none>
I20260929 22:46:14.488761 19944 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:14.488812 19944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:14.488900 19944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:14.489878 19944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "bff057208ba64a0786305f281f99d6f3"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "9d9a2dfaba0dcb24dcb91c69aaa9f88e"
server_key_iv: "f51926d8a6f38c47190cf58802174343"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.490165 19944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "bff057208ba64a0786305f281f99d6f3"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "9d9a2dfaba0dcb24dcb91c69aaa9f88e"
server_key_iv: "f51926d8a6f38c47190cf58802174343"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.491390 19944 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:14.492195 19959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:14.492416 19944 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:46:14.492508 19944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "bff057208ba64a0786305f281f99d6f3"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "9d9a2dfaba0dcb24dcb91c69aaa9f88e"
server_key_iv: "f51926d8a6f38c47190cf58802174343"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.492584 19944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:14.507588 19944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:14.510171 19944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:14.510325 19944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:14.515450 19944 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:43177
I20260929 22:46:14.515491 20021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:43177 every 8 connection(s)
I20260929 22:46:14.515847 19944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:46:14.516548 20022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:14.518694 20022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Bootstrap starting.
I20260929 22:46:14.519240 20022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:14.519488 20022 log.cc:824] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:14.520146 20022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: No bootstrap required, opened a new log
I20260929 22:46:14.521320 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 19944
I20260929 22:46:14.521453 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:46:14.521641 12398 external_mini_cluster.cc:1428] Setting key b7b007d09027e10ef69336438083d2a4
I20260929 22:46:14.522470 20022 raft_consensus.cc:348] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bff057208ba64a0786305f281f99d6f3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43177 } }
I20260929 22:46:14.522632 20022 raft_consensus.cc:374] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:14.522670 20022 raft_consensus.cc:729] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bff057208ba64a0786305f281f99d6f3, State: Initialized, Role: FOLLOWER
I20260929 22:46:14.522837 20022 consensus_queue.cc:260] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bff057208ba64a0786305f281f99d6f3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43177 } }
I20260929 22:46:14.522930 20022 raft_consensus.cc:388] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:46:14.522965 20022 raft_consensus.cc:482] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:46:14.523020 20022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:14.523722 20022 raft_consensus.cc:504] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bff057208ba64a0786305f281f99d6f3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43177 } }
I20260929 22:46:14.523809 20022 leader_election.cc:302] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bff057208ba64a0786305f281f99d6f3; no voters:
I20260929 22:46:14.523980 20022 leader_election.cc:288] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:46:14.524025 20027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:14.524176 20027 raft_consensus.cc:686] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [term 1 LEADER]: Becoming Leader. State: Replica: bff057208ba64a0786305f281f99d6f3, State: Running, Role: LEADER
I20260929 22:46:14.524238 20022 sys_catalog.cc:564] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:46:14.524308 20027 consensus_queue.cc:237] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bff057208ba64a0786305f281f99d6f3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43177 } }
I20260929 22:46:14.524732 20027 sys_catalog.cc:455] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bff057208ba64a0786305f281f99d6f3. Latest consensus state: current_term: 1 leader_uuid: "bff057208ba64a0786305f281f99d6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bff057208ba64a0786305f281f99d6f3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43177 } } }
I20260929 22:46:14.525004 20027 sys_catalog.cc:458] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:14.524927 20029 sys_catalog.cc:455] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bff057208ba64a0786305f281f99d6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bff057208ba64a0786305f281f99d6f3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43177 } } }
I20260929 22:46:14.525415 20029 sys_catalog.cc:458] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:14.525538 20036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:46:14.526037 20036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:46:14.527660 20036 catalog_manager.cc:1347] Generated new cluster ID: 9f282f470bf5458296954c2c4b2bcb2b
I20260929 22:46:14.527706 20036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:14.532418 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.522171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.12.27.190:43177)
0929 22:46:14.522348 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:14.522355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:14.522380 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:46:14.522481 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:14.522486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:14.522527 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:14.522660 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:14.523437 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.524801 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.525902 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.526458 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.526587 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.529101 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:14.529105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:14.529105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:14.529116 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:14.530816 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.531243 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.531246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.531247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.531349 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.531568 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.531569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.531570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.531863 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:14.532050 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:14.532120 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 22:46:14.532258 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260929 22:46:14.551115 20036 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:46:14.551605 20036 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:46:14.565595 20036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Generated new TSK 0
I20260929 22:46:14.565791 20036 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab.
Entry for principal oryx/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab.
I20260929 22:46:14.599929 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43177
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:14.687110 20048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:14.687322 20048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:14.687347 20048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:14.688740 20048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:14.688787 20048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:14.688851 20048 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:46:14.688889 20048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:46:14.690487 20048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:43177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:14.690681 20048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:14.690863 20048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:14.696264 20053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:14.696326 20054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:14.696293 20048 server_base.cc:1034] running on GCE node
W20260929 22:46:14.696369 20056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:14.696753 20048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:14.697001 20048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:14.698145 20048 hybrid_clock.cc:648] HybridClock initialized: now 1790721974698132 us; error 28 us; skew 500 ppm
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:14.700585 20048 init.cc:377] Logged in from keytab as oryx/127.12.27.129@KRBTEST.COM (short username oryx)
I20260929 22:46:14.701030 20048 webserver.cc:460] Webserver started at http://127.12.27.129:43087/ using document root <none> and password file <none>
I20260929 22:46:14.701268 20048 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:14.701313 20048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:14.701479 20048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:14.702483 20048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "d6cb8a9226a346149a189971b7519a60"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "b0a9a36e1b593e8e9d746c8241d1f3b1"
server_key_iv: "a5b4aef7c895f000a358d6480f6f8e74"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.702829 20048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "d6cb8a9226a346149a189971b7519a60"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "b0a9a36e1b593e8e9d746c8241d1f3b1"
server_key_iv: "a5b4aef7c895f000a358d6480f6f8e74"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.704202 20048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:46:14.704927 20063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:14.705116 20048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:14.705204 20048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "d6cb8a9226a346149a189971b7519a60"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "b0a9a36e1b593e8e9d746c8241d1f3b1"
server_key_iv: "a5b4aef7c895f000a358d6480f6f8e74"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.705274 20048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:14.718250 20048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:14.720400 20048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:14.720556 20048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:14.721102 20048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:14.721168 20048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:14.721213 20048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:14.721248 20048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:14.728463 20048 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:41845
I20260929 22:46:14.728544 20178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:41845 every 8 connection(s)
I20260929 22:46:14.728901 20048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:46:14.731195 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.721553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:56575 (local address 127.12.27.190:43177)
0929 22:46:14.721624 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:14.721626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:14.721811 (+ 185us) server_negotiation.cc:407] Connection header received
0929 22:46:14.722279 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:14.722280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:14.722299 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:14.722394 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:14.723219 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.724109 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.725619 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.726014 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.726098 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.728458 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:14.728459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:14.728459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:14.728468 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:14.730050 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.730431 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.730432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.730432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.730482 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.730683 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.730684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.730684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.730780 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:14.730829 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:14.731065 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 22:46:14.731129 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:46:14.731369 20072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.721532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.12.27.129:56575)
0929 22:46:14.721676 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:14.721715 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:14.722184 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:14.722461 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:14.722464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:14.722820 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:14.723109 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.723116 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.724208 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.724209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.725528 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.725531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.726118 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.726118 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.726256 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.726788 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:14.726796 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:14.728342 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:14.730131 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.730137 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.730139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.730346 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.730538 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.730539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.730539 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.730631 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.730834 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:14.730838 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:14.730948 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 22:46:14.731038 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 22:46:14.731153 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":80,"threads_started":1}
I20260929 22:46:14.732031 20179 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43177
I20260929 22:46:14.732110 20179 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:14.732282 20179 heartbeater.cc:511] Master 127.12.27.190:43177 requested a full tablet report, sending...
I20260929 22:46:14.732867 19976 ts_manager.cc:194] Registered new tserver with Master: d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845)
I20260929 22:46:14.733573 19976 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:56575
I20260929 22:46:14.734807 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20048
I20260929 22:46:14.734926 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:46:14.735109 12398 external_mini_cluster.cc:1428] Setting key 9a838944317314a4b75e46a86bfbd99b
I20260929 22:46:14.739811 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.733197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:43749 (local address 127.12.27.190:43177)
0929 22:46:14.733253 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:14.733255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:14.733396 (+ 141us) server_negotiation.cc:407] Connection header received
0929 22:46:14.733474 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:14.733474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:14.733484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:14.733533 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:14.733915 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.734654 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.735575 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.735853 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.735948 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.736935 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:14.736936 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:14.736937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:14.736943 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:14.738506 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.738938 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.738939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.738939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.739001 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.739229 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.739230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.739231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.739355 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:14.739438 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:14.739607 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 22:46:14.739706 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:46:14.739814 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.733134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.12.27.129:43749)
0929 22:46:14.733322 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:14.733332 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:14.733409 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:14.733535 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:14.733535 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:14.733775 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:14.733848 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.733851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.734764 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.734765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.735479 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.735485 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.735949 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.735950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.736021 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.736501 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:14.736505 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:14.736825 (+ 320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:14.738618 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.738619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.738619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.738863 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.739074 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.739075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.739075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.739138 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.739430 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:14.739431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:14.739479 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 22:46:14.739579 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 22:46:14.739707 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for oryx/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab.
Entry for principal oryx/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab.
I20260929 22:46:14.762486 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43177
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:14.842784 20188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:14.843000 20188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:14.843025 20188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:14.844192 20188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:14.844233 20188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:14.844254 20188 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:46:14.844272 20188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:46:14.845757 20188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:43177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:14.845996 20188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:14.846233 20188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:14.851282 20196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:14.851239 20194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:14.851238 20193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:14.851361 20188 server_base.cc:1034] running on GCE node
I20260929 22:46:14.851713 20188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:14.851926 20188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:14.853068 20188 hybrid_clock.cc:648] HybridClock initialized: now 1790721974853058 us; error 26 us; skew 500 ppm
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:14.855754 20188 init.cc:377] Logged in from keytab as oryx/127.12.27.130@KRBTEST.COM (short username oryx)
I20260929 22:46:14.856175 20188 webserver.cc:460] Webserver started at http://127.12.27.130:34809/ using document root <none> and password file <none>
I20260929 22:46:14.856421 20188 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:14.856487 20188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:14.856647 20188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:14.857718 20188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "f9cfaca854af4a17be8098e94d97bfe5"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "d411bfee92a6ebfc6466fff9765c03ff"
server_key_iv: "fd448f623117f86847071b86a078b352"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.858089 20188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "f9cfaca854af4a17be8098e94d97bfe5"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "d411bfee92a6ebfc6466fff9765c03ff"
server_key_iv: "fd448f623117f86847071b86a078b352"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.859395 20188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:14.860267 20203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:14.860455 20188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:46:14.860548 20188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "f9cfaca854af4a17be8098e94d97bfe5"
format_stamp: "Formatted at 2026-09-29 22:46:14 on dist-test-slave-00d6"
server_key: "d411bfee92a6ebfc6466fff9765c03ff"
server_key_iv: "fd448f623117f86847071b86a078b352"
server_key_version: "encryptionkey@0"
I20260929 22:46:14.860630 20188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:14.890931 20188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:14.892972 20188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:14.893143 20188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:14.893656 20188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:14.893720 20188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:14.893770 20188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:14.893793 20188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:46:14 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:14.901180 20188 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:42483
I20260929 22:46:14.901269 20318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:42483 every 8 connection(s)
I20260929 22:46:14.901625 20188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:46:14.904196 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.894203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:45069 (local address 127.12.27.190:43177)
0929 22:46:14.894265 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:14.894267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:14.894499 (+ 232us) server_negotiation.cc:407] Connection header received
0929 22:46:14.895124 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:14.895125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:14.895137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:14.895213 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:14.896252 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.896811 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.898000 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.898205 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.898297 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.901067 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:14.901068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:14.901069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:14.901076 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:14.902689 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.903146 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.903147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.903147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.903198 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.903393 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.903394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.903394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.903497 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:14.903547 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:14.904073 (+ 526us) server_negotiation.cc:299] Negotiation successful
0929 22:46:14.904134 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:46:14.904407 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.894202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.12.27.130:45069)
0929 22:46:14.894373 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:14.894415 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:14.895020 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:14.895346 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:14.895351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:14.895779 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:14.896130 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.896138 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.896921 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.896923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.897890 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.897893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.898320 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.898321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.898447 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.898940 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:14.898948 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:14.900966 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:14.902833 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.902839 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.902841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.903072 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.903240 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.903240 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.903240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.903326 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.903569 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:14.903574 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:14.903953 (+ 379us) client_negotiation.cc:769] Sending connection context
0929 22:46:14.904045 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 22:46:14.904166 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":86,"threads_started":1}
I20260929 22:46:14.904892 20319 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43177
I20260929 22:46:14.904976 20319 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:14.905170 20319 heartbeater.cc:511] Master 127.12.27.190:43177 requested a full tablet report, sending...
I20260929 22:46:14.905541 19975 ts_manager.cc:194] Registered new tserver with Master: f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483)
I20260929 22:46:14.905925 19975 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:45069
I20260929 22:46:14.907307 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20188
I20260929 22:46:14.907428 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:46:14.907617 12398 external_mini_cluster.cc:1428] Setting key fe3b95c4b88cc1d64e4cd5d35c7629d5
I20260929 22:46:14.911836 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.906014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:50379 (local address 127.12.27.190:43177)
0929 22:46:14.906103 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:14.906105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:14.906156 (+ 51us) server_negotiation.cc:407] Connection header received
0929 22:46:14.906236 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:14.906237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:14.906247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:14.906292 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:14.906591 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.907092 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.908119 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.908318 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.908405 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.909342 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:14.909344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:14.909344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:14.909351 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:14.910695 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.911106 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.911107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.911107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.911154 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:14.911350 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:14.911350 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:14.911351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:14.911475 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:14.911525 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:14.911708 (+ 183us) server_negotiation.cc:299] Negotiation successful
0929 22:46:14.911777 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260929 22:46:14.911959 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:14.905962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.12.27.130:50379)
0929 22:46:14.906095 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:14.906107 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:14.906169 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:14.906305 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:14.906305 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:14.906466 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:14.906520 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.906522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.907219 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.907220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.908040 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:14.908042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:14.908405 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:14.908406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:14.908474 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:14.908965 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:14.908976 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:14.909256 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:14.910785 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.910786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.910787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.911034 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.911218 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:14.911219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:14.911220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:14.911289 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:14.911540 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:14.911541 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:14.911589 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 22:46:14.911682 (+ 93us) client_negotiation.cc:240] Negotiation successful
0929 22:46:14.911795 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for oryx/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab.
Entry for principal oryx/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab.
I20260929 22:46:14.936000 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43177
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:15.016741 20328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:15.016990 20328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:15.017030 20328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:15.018180 20328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:15.018251 20328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:15.018285 20328 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 22:46:15.018324 20328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:46:15.019800 20328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.27.190:43177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:15.020067 20328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:15.020314 20328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:15.025427 20336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:15.025507 20333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:15.025427 20334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:15.025571 20328 server_base.cc:1034] running on GCE node
I20260929 22:46:15.025853 20328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:15.026103 20328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:15.027238 20328 hybrid_clock.cc:648] HybridClock initialized: now 1790721975027232 us; error 29 us; skew 500 ppm
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721975, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:15.029631 20328 init.cc:377] Logged in from keytab as oryx/127.12.27.131@KRBTEST.COM (short username oryx)
I20260929 22:46:15.030079 20328 webserver.cc:460] Webserver started at http://127.12.27.131:38585/ using document root <none> and password file <none>
I20260929 22:46:15.030308 20328 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:15.030375 20328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:15.030526 20328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:15.031572 20328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
format_stamp: "Formatted at 2026-09-29 22:46:15 on dist-test-slave-00d6"
server_key: "a7c931074484dcf9d4ee0b5777505407"
server_key_iv: "c9bfa2a6f429b477096b92615e4c9916"
server_key_version: "encryptionkey@0"
I20260929 22:46:15.031997 20328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
format_stamp: "Formatted at 2026-09-29 22:46:15 on dist-test-slave-00d6"
server_key: "a7c931074484dcf9d4ee0b5777505407"
server_key_iv: "c9bfa2a6f429b477096b92615e4c9916"
server_key_version: "encryptionkey@0"
I20260929 22:46:15.033491 20328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:15.034161 20343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.034332 20328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:46:15.034428 20328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
format_stamp: "Formatted at 2026-09-29 22:46:15 on dist-test-slave-00d6"
server_key: "a7c931074484dcf9d4ee0b5777505407"
server_key_iv: "c9bfa2a6f429b477096b92615e4c9916"
server_key_version: "encryptionkey@0"
I20260929 22:46:15.034509 20328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:15.055908 20328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:15.057878 20328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:15.058049 20328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:15.058637 20328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:15.058687 20328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.058727 20328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:15.058746 20328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721975, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:15.066323 20328 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38055
I20260929 22:46:15.066433 20458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38055 every 8 connection(s)
I20260929 22:46:15.066705 20328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:46:15.068617 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.059281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:36245 (local address 127.12.27.190:43177)
0929 22:46:15.059329 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.059332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.059675 (+ 343us) server_negotiation.cc:407] Connection header received
0929 22:46:15.060200 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.060201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.060215 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.060291 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.061024 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.061677 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.062673 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.062874 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.062963 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.065755 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:15.065757 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:15.065757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:15.065766 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:15.067465 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.067885 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.067885 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.067886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.067938 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.068104 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.068104 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.068105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.068195 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:15.068239 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.068491 (+ 252us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.068555 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:46:15.068770 20352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.058988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.12.27.131:36245)
0929 22:46:15.059516 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.059567 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.060096 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.060404 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.060409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.060732 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:15.060921 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.060926 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.061768 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.061770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.062578 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.062580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.062974 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.062975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.063121 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.063744 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:15.063755 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:15.065667 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:15.067532 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:15.067536 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:15.067537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:15.067819 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:15.067980 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:15.067981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:15.067981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:15.068066 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:15.068256 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:15.068260 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:15.068365 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.068461 (+ 96us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.068579 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":64,"threads_started":1}
I20260929 22:46:15.069285 20459 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43177
I20260929 22:46:15.069368 20459 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:15.069545 20459 heartbeater.cc:511] Master 127.12.27.190:43177 requested a full tablet report, sending...
I20260929 22:46:15.069957 19976 ts_manager.cc:194] Registered new tserver with Master: 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.070333 19976 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:36245
I20260929 22:46:15.070816 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20328
I20260929 22:46:15.070910 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:46:15.071110 12398 external_mini_cluster.cc:1428] Setting key 8de31b2d6eaef6d3fec4217d5d7a7e2d
I20260929 22:46:15.072003 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:46:15.077344 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.070648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:34925 (local address 127.12.27.190:43177)
0929 22:46:15.071259 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.071261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.071393 (+ 132us) server_negotiation.cc:407] Connection header received
0929 22:46:15.071439 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.071440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.071450 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.071503 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.071885 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.072445 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.073505 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.073674 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.073722 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.074633 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:15.074635 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:15.074635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:15.074643 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:15.076263 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.076592 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.076593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.076594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.076654 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.076825 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.076825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.076826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.076962 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:15.077032 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.077168 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.077245 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585}
I20260929 22:46:15.077371 20465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.070584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.12.27.131:34925)
0929 22:46:15.071317 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.071328 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.071386 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.071517 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.071518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.071729 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:15.071802 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.071803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.072538 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.072539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.073426 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.073428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.073744 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.073745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.073815 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.074255 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:15.074259 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:15.074551 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:15.076349 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:15.076350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:15.076350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:15.076520 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:15.076719 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:15.076719 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:15.076720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:15.076766 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:15.077025 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:15.077026 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:15.077059 (+ 33us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.077120 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.077235 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":668,"threads_started":1}
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721975, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:46:15.093926 20026 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:15.088598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54924 (local address 127.12.27.190:43177)
0929 22:46:15.088656 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.088658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.088683 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:46:15.088780 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.088781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.088793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.088865 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.089415 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.089888 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.090647 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.090831 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.090909 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.093836 (+ 2927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54924: BlockingRecv error: recv got EOF from 127.0.0.1:54924 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721975, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:15.100907 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.094665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.12.27.190:43177)
0929 22:46:15.094714 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.094716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.094805 (+ 89us) server_negotiation.cc:407] Connection header received
0929 22:46:15.094841 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.094842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.094850 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.094905 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.095305 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.095844 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.096493 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.096669 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.096719 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.098633 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:15.098634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:15.098634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:15.098640 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:15.100055 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.100342 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.100343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.100343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.100402 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.100552 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.100553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.100553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.100639 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:15.100707 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.100789 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.100842 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 22:46:15.102413 19976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:46:15.104177 19976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:46:15.110883 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.106842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38750 (local address 127.12.27.131:38055)
0929 22:46:15.106997 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.107001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.107564 (+ 563us) server_negotiation.cc:407] Connection header received
0929 22:46:15.107669 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.107672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.107687 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.107780 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.107909 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.108746 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.109995 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.110487 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.110570 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.110646 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.110761 (+ 115us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.110795 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260929 22:46:15.110874 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.106650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38055 (local address 127.0.0.1:38750)
0929 22:46:15.107486 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.107500 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.107562 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.107776 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.107777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.107779 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.107816 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.107818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.108810 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.108811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.109935 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.109937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.110581 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.110582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.110660 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.110674 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.110746 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.110795 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"thread_start_us":74,"threads_started":1}
I20260929 22:46:15.110981 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.106484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:42483 (local address 127.0.0.1:49406)
0929 22:46:15.106733 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.106745 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.106798 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.107342 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.107343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.107345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.107383 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.107384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.108609 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.108610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.109829 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.109832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.110764 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.110764 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.110824 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.110827 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.110871 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.110896 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":88,"threads_started":1}
I20260929 22:46:15.111105 20482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.106465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41845 (local address 127.0.0.1:57120)
0929 22:46:15.106624 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.106666 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.106729 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.107015 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.107018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.107020 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.107098 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.107099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.108521 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.108522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.109703 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.109705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.110729 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.110731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.110792 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.110796 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.110845 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.110891 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":55,"threads_started":1}
I20260929 22:46:15.111235 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.106572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49406 (local address 127.12.27.130:42483)
0929 22:46:15.107135 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.107139 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.107150 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:46:15.107187 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.107189 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.107205 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.107274 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.107472 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.108544 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.109921 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.110608 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.110665 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.110736 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.111099 (+ 363us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.111148 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":75,"threads_started":1}
I20260929 22:46:15.111601 20393 tablet_service.cc:1467] Processing CreateTablet for tablet 053cef2aeeca4d02b1c62e014af3475a (DEFAULT_TABLE table=test-table [id=d9e5674ba59744aa95eea4100f3f6462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.112008 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.106663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.12.27.129:41845)
0929 22:46:15.106840 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.106845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.106855 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:15.106894 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.106896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.106910 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.107011 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.107221 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.108442 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.109791 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.110538 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.110613 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.110692 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.111789 (+ 1097us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.111837 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260929 22:46:15.112082 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 053cef2aeeca4d02b1c62e014af3475a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.112249 20253 tablet_service.cc:1467] Processing CreateTablet for tablet 053cef2aeeca4d02b1c62e014af3475a (DEFAULT_TABLE table=test-table [id=d9e5674ba59744aa95eea4100f3f6462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.112594 20253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 053cef2aeeca4d02b1c62e014af3475a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.112602 20113 tablet_service.cc:1467] Processing CreateTablet for tablet 053cef2aeeca4d02b1c62e014af3475a (DEFAULT_TABLE table=test-table [id=d9e5674ba59744aa95eea4100f3f6462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.112953 20113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 053cef2aeeca4d02b1c62e014af3475a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.115863 20487 tablet_bootstrap.cc:492] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Bootstrap starting.
I20260929 22:46:15.116359 20489 tablet_bootstrap.cc:492] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Bootstrap starting.
I20260929 22:46:15.116621 20487 tablet_bootstrap.cc:654] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.116916 20489 tablet_bootstrap.cc:654] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.116935 20487 log.cc:824] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:15.117213 20489 log.cc:824] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:15.117306 20488 tablet_bootstrap.cc:492] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Bootstrap starting.
I20260929 22:46:15.117748 20487 tablet_bootstrap.cc:492] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: No bootstrap required, opened a new log
I20260929 22:46:15.117817 20487 ts_tablet_manager.cc:1397] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:46:15.117969 20489 tablet_bootstrap.cc:492] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: No bootstrap required, opened a new log
I20260929 22:46:15.118017 20489 ts_tablet_manager.cc:1397] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:46:15.118044 20488 tablet_bootstrap.cc:654] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.118302 20488 log.cc:824] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:15.118911 20488 tablet_bootstrap.cc:492] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: No bootstrap required, opened a new log
I20260929 22:46:15.118952 20488 ts_tablet_manager.cc:1397] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:46:15.119810 20487 raft_consensus.cc:348] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.119982 20487 raft_consensus.cc:374] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.119918 20489 raft_consensus.cc:348] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.120016 20487 raft_consensus.cc:729] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ed862e3bb14aa98ac35b7fa6dab6c2, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.120054 20489 raft_consensus.cc:374] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.120083 20489 raft_consensus.cc:729] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.120149 20487 consensus_queue.cc:260] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.120182 20489 consensus_queue.cc:260] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.120426 20487 ts_tablet_manager.cc:1428] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:46:15.120426 20489 ts_tablet_manager.cc:1428] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:46:15.120471 20319 heartbeater.cc:503] Master 127.12.27.190:43177 was elected leader, sending a full tablet report...
I20260929 22:46:15.120553 20459 heartbeater.cc:503] Master 127.12.27.190:43177 was elected leader, sending a full tablet report...
I20260929 22:46:15.120988 20488 raft_consensus.cc:348] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.121131 20488 raft_consensus.cc:374] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.121178 20488 raft_consensus.cc:729] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6cb8a9226a346149a189971b7519a60, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.121304 20488 consensus_queue.cc:260] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.121575 20488 ts_tablet_manager.cc:1428] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:46:15.121578 20179 heartbeater.cc:503] Master 127.12.27.190:43177 was elected leader, sending a full tablet report...
W20260929 22:46:15.152473 20320 tablet.cc:2369] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:46:15.229640 20180 tablet.cc:2369] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:46:15.317255 20460 tablet.cc:2369] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:46:15.348855 20493 raft_consensus.cc:482] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:46:15.349025 20493 raft_consensus.cc:504] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.349421 20493 leader_election.cc:288] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.352645 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.349918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:52563 (local address 127.12.27.131:38055)
0929 22:46:15.349965 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.349967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.350083 (+ 116us) server_negotiation.cc:407] Connection header received
0929 22:46:15.350111 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.350112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.350122 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.350181 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.350328 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.350849 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.351961 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.352284 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.352373 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.352381 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.352537 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.352573 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:46:15.352656 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.349760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:49589 (local address 127.12.27.129:41845)
0929 22:46:15.349820 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.349823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.349834 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:46:15.349866 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.349867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.349878 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.349957 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.350183 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.350854 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.351890 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.352279 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.352356 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.352365 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.352560 (+ 195us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.352598 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:46:15.352654 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.349792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38055 (local address 127.12.27.130:52563)
0929 22:46:15.349999 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.350012 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.350066 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.350196 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.350197 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.350199 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.350261 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.350263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.350964 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.350964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.351862 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.351865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.352394 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.352395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.352462 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.352465 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.352507 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.352566 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":32,"thread_start_us":114,"threads_started":1}
I20260929 22:46:15.352669 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.349663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41845 (local address 127.12.27.130:49589)
0929 22:46:15.349729 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.349742 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.349789 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.349976 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.349977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.349979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.350071 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.350073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.350964 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.350965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.351810 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.351812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.352363 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.352364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.352468 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.352472 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.352544 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.352580 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":58}
I20260929 22:46:15.353202 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053cef2aeeca4d02b1c62e014af3475a" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60" is_pre_election: true
I20260929 22:46:15.353251 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053cef2aeeca4d02b1c62e014af3475a" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" is_pre_election: true
I20260929 22:46:15.353367 20133 raft_consensus.cc:2454] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.353389 20413 raft_consensus.cc:2454] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.353592 20205 leader_election.cc:302] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.353713 20493 raft_consensus.cc:2781] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:46:15.353768 20493 raft_consensus.cc:482] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:46:15.353801 20493 raft_consensus.cc:3037] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.354707 20493 raft_consensus.cc:504] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.354835 20493 leader_election.cc:288] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Requested vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.355022 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053cef2aeeca4d02b1c62e014af3475a" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60"
I20260929 22:46:15.355047 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "053cef2aeeca4d02b1c62e014af3475a" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
I20260929 22:46:15.355118 20413 raft_consensus.cc:3037] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.355122 20133 raft_consensus.cc:3037] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.355859 20413 raft_consensus.cc:2454] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.355959 20133 raft_consensus.cc:2454] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.356024 20205 leader_election.cc:302] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.356101 20493 raft_consensus.cc:2781] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:15.356251 20493 raft_consensus.cc:686] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Becoming Leader. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Running, Role: LEADER
I20260929 22:46:15.356357 20493 consensus_queue.cc:237] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } }
I20260929 22:46:15.357172 19976 catalog_manager.cc:5495] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260929 22:46:15.391853 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.389346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.12.27.130:42483)
0929 22:46:15.389413 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.389415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.389424 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:46:15.389467 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.389467 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.389485 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.389563 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:15.389709 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.390188 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.391026 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.391223 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.391314 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.391499 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.391593 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.391706 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.391745 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.391765 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:46:15.393647 20133 raft_consensus.cc:1261] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.393680 20413 raft_consensus.cc:1261] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.394061 20493 consensus_queue.cc:1035] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.394227 20497 consensus_queue.cc:1035] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.397372 20501 mvcc.cc:205] Tried to move back new op lower bound from 7334797211209461760 to 7334797211060203520. Current Snapshot: MvccSnapshot[applied={T|T < 7334797211209461760 or (T in {7334797211209461760})}]
I20260929 22:46:15.399408 19976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:15.399506 19976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:15.400235 19976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Sending DeleteTablet for 3 replicas of tablet 053cef2aeeca4d02b1c62e014af3475a
I20260929 22:46:15.400547 20113 tablet_service.cc:1514] Processing DeleteTablet for tablet 053cef2aeeca4d02b1c62e014af3475a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:57120
I20260929 22:46:15.400569 20253 tablet_service.cc:1514] Processing DeleteTablet for tablet 053cef2aeeca4d02b1c62e014af3475a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49406
I20260929 22:46:15.400727 20393 tablet_service.cc:1514] Processing DeleteTablet for tablet 053cef2aeeca4d02b1c62e014af3475a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:38750
I20260929 22:46:15.400965 20512 tablet_replica.cc:330] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: stopping tablet replica
I20260929 22:46:15.400978 20510 tablet_replica.cc:330] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: stopping tablet replica
I20260929 22:46:15.401093 20510 raft_consensus.cc:2229] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:15.401108 20512 raft_consensus.cc:2229] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:15.401051 19976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:46:15.401190 19976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:46:15.401392 20510 raft_consensus.cc:2258] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.401467 20512 raft_consensus.cc:2258] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.402073 20510 ts_tablet_manager.cc:1905] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.402524 20113 tablet_service.cc:1467] Processing CreateTablet for tablet 7e7f9daa72c44d8fb84d029e95c5217e (DEFAULT_TABLE table=test-table [id=0548a09fcd9146cdac5adde7f5054fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.402572 20253 tablet_service.cc:1467] Processing CreateTablet for tablet 7e7f9daa72c44d8fb84d029e95c5217e (DEFAULT_TABLE table=test-table [id=0548a09fcd9146cdac5adde7f5054fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.402628 20113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e7f9daa72c44d8fb84d029e95c5217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.402679 20253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e7f9daa72c44d8fb84d029e95c5217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.403724 20393 tablet_service.cc:1467] Processing CreateTablet for tablet 7e7f9daa72c44d8fb84d029e95c5217e (DEFAULT_TABLE table=test-table [id=0548a09fcd9146cdac5adde7f5054fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.403833 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e7f9daa72c44d8fb84d029e95c5217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.404354 20512 ts_tablet_manager.cc:1905] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.405231 20510 ts_tablet_manager.cc:1918] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:15.405288 20489 tablet_bootstrap.cc:492] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Bootstrap starting.
I20260929 22:46:15.405299 20510 log.cc:1196] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/053cef2aeeca4d02b1c62e014af3475a
I20260929 22:46:15.405627 20510 ts_tablet_manager.cc:1939] T 053cef2aeeca4d02b1c62e014af3475a P d6cb8a9226a346149a189971b7519a60: Deleting consensus metadata
I20260929 22:46:15.405788 20489 tablet_bootstrap.cc:654] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.406036 19961 catalog_manager.cc:4841] TS d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845): tablet 053cef2aeeca4d02b1c62e014af3475a (table test-table [id=d9e5674ba59744aa95eea4100f3f6462]) successfully deleted
I20260929 22:46:15.406157 20487 tablet_bootstrap.cc:492] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Bootstrap starting.
I20260929 22:46:15.406343 20512 ts_tablet_manager.cc:1918] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:15.406391 20512 log.cc:1196] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/053cef2aeeca4d02b1c62e014af3475a
I20260929 22:46:15.406543 20487 tablet_bootstrap.cc:654] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.406574 20512 ts_tablet_manager.cc:1939] T 053cef2aeeca4d02b1c62e014af3475a P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting consensus metadata
I20260929 22:46:15.407217 19961 catalog_manager.cc:4841] TS 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055): tablet 053cef2aeeca4d02b1c62e014af3475a (table test-table [id=d9e5674ba59744aa95eea4100f3f6462]) successfully deleted
I20260929 22:46:15.407471 20488 tablet_bootstrap.cc:492] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Bootstrap starting.
I20260929 22:46:15.407850 20488 tablet_bootstrap.cc:654] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.407820 20511 tablet_replica.cc:330] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: stopping tablet replica
I20260929 22:46:15.407944 20511 raft_consensus.cc:2229] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:46:15.408051 20511 raft_consensus.cc:2258] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.408301 20487 tablet_bootstrap.cc:492] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: No bootstrap required, opened a new log
I20260929 22:46:15.408346 20487 ts_tablet_manager.cc:1397] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:46:15.408432 20511 ts_tablet_manager.cc:1905] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.408510 20487 raft_consensus.cc:348] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.408577 20487 raft_consensus.cc:374] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.408598 20487 raft_consensus.cc:729] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ed862e3bb14aa98ac35b7fa6dab6c2, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.408639 20487 consensus_queue.cc:260] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.408713 20487 ts_tablet_manager.cc:1428] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.409228 20489 tablet_bootstrap.cc:492] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: No bootstrap required, opened a new log
I20260929 22:46:15.409273 20489 ts_tablet_manager.cc:1397] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260929 22:46:15.409420 20489 raft_consensus.cc:348] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.409482 20489 raft_consensus.cc:374] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.409502 20489 raft_consensus.cc:729] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.409549 20489 consensus_queue.cc:260] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.409628 20489 ts_tablet_manager.cc:1428] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.410153 20488 tablet_bootstrap.cc:492] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: No bootstrap required, opened a new log
I20260929 22:46:15.410197 20488 ts_tablet_manager.cc:1397] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 22:46:15.410512 20488 raft_consensus.cc:348] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.410579 20488 raft_consensus.cc:374] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.410598 20488 raft_consensus.cc:729] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6cb8a9226a346149a189971b7519a60, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.410605 20511 ts_tablet_manager.cc:1918] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:15.410653 20511 log.cc:1196] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/053cef2aeeca4d02b1c62e014af3475a
I20260929 22:46:15.410638 20488 consensus_queue.cc:260] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.410718 20488 ts_tablet_manager.cc:1428] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.410897 20511 ts_tablet_manager.cc:1939] T 053cef2aeeca4d02b1c62e014af3475a P f9cfaca854af4a17be8098e94d97bfe5: Deleting consensus metadata
I20260929 22:46:15.411278 19962 catalog_manager.cc:4841] TS f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483): tablet 053cef2aeeca4d02b1c62e014af3475a (table test-table [id=d9e5674ba59744aa95eea4100f3f6462]) successfully deleted
I20260929 22:46:15.501183 20495 raft_consensus.cc:482] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:46:15.501278 20495 raft_consensus.cc:504] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.501631 20495 leader_election.cc:288] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.505138 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.501932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42897 (local address 127.12.27.131:38055)
0929 22:46:15.502053 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.502055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.502066 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:46:15.502095 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.502096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.502105 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.502163 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.502359 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.503134 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.504284 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.504763 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.504844 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.504857 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.505030 (+ 173us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.505071 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260929 22:46:15.505157 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.501794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38055 (local address 127.12.27.129:42897)
0929 22:46:15.501914 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.501926 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.501981 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.502178 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.502179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.502180 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.502252 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.502254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.503254 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.503255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.504184 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.504187 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.504860 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.504862 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.504941 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.504944 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.505020 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.505061 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":39,"thread_start_us":55,"threads_started":1}
I20260929 22:46:15.505594 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.501995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42195 (local address 127.12.27.130:42483)
0929 22:46:15.502085 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.502087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.502095 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:15.502120 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.502120 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.502131 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.502179 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:15.502421 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.503140 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.504622 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.505189 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.505256 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.505263 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.505489 (+ 226us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.505533 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260929 22:46:15.505606 20517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.501800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:42483 (local address 127.12.27.129:42195)
0929 22:46:15.501993 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.502002 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.502047 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.502230 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.502231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.502233 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:15.502306 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.502308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.503228 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.503229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.504505 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.504508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.505340 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.505342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.505425 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.505429 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.505480 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.505517 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":32,"thread_start_us":96,"threads_started":1}
I20260929 22:46:15.505587 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e7f9daa72c44d8fb84d029e95c5217e" candidate_uuid: "d6cb8a9226a346149a189971b7519a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" is_pre_election: true
I20260929 22:46:15.505686 20413 raft_consensus.cc:2454] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6cb8a9226a346149a189971b7519a60 in term 0.
I20260929 22:46:15.505890 20065 leader_election.cc:302] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, d6cb8a9226a346149a189971b7519a60; no voters:
I20260929 22:46:15.506016 20495 raft_consensus.cc:2781] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:46:15.506045 20495 raft_consensus.cc:482] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:46:15.506063 20495 raft_consensus.cc:3037] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.505997 20273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e7f9daa72c44d8fb84d029e95c5217e" candidate_uuid: "d6cb8a9226a346149a189971b7519a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9cfaca854af4a17be8098e94d97bfe5" is_pre_election: true
I20260929 22:46:15.506129 20273 raft_consensus.cc:2454] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6cb8a9226a346149a189971b7519a60 in term 0.
I20260929 22:46:15.506824 20495 raft_consensus.cc:504] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.506987 20495 leader_election.cc:288] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [CANDIDATE]: Term 1 election: Requested vote from peers f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.507166 20273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e7f9daa72c44d8fb84d029e95c5217e" candidate_uuid: "d6cb8a9226a346149a189971b7519a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9cfaca854af4a17be8098e94d97bfe5"
I20260929 22:46:15.507169 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e7f9daa72c44d8fb84d029e95c5217e" candidate_uuid: "d6cb8a9226a346149a189971b7519a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
I20260929 22:46:15.507242 20413 raft_consensus.cc:3037] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.507257 20273 raft_consensus.cc:3037] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.507997 20273 raft_consensus.cc:2454] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6cb8a9226a346149a189971b7519a60 in term 1.
I20260929 22:46:15.508088 20413 raft_consensus.cc:2454] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6cb8a9226a346149a189971b7519a60 in term 1.
I20260929 22:46:15.508184 20066 leader_election.cc:302] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6cb8a9226a346149a189971b7519a60, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.508260 20495 raft_consensus.cc:2781] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:15.508428 20495 raft_consensus.cc:686] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 1 LEADER]: Becoming Leader. State: Replica: d6cb8a9226a346149a189971b7519a60, State: Running, Role: LEADER
I20260929 22:46:15.508522 20495 consensus_queue.cc:237] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.509322 19976 catalog_manager.cc:5495] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6cb8a9226a346149a189971b7519a60 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "d6cb8a9226a346149a189971b7519a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } health_report { overall_health: UNKNOWN } } }
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721974, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.190@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:15.547001 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.540423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54948 (local address 127.12.27.190:43177)
0929 22:46:15.540496 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.540498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.540663 (+ 165us) server_negotiation.cc:407] Connection header received
0929 22:46:15.540713 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.540713 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.540724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.540764 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.541220 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.541699 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.542378 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.542553 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.542601 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.544594 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:15.544595 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:15.544596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:15.544602 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:15.546048 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.546380 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.546381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.546382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.546431 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.546598 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.546599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.546599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.546694 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:15.546743 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.546860 (+ 117us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.546935 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 22:46:15.547132 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.540370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43177 (local address 127.0.0.1:54948)
0929 22:46:15.540579 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.540590 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.540659 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.540783 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.540783 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.541105 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:15.541153 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.541155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.541766 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.541766 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.542292 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.542293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.542617 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.542618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.542658 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.543142 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:15.543146 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:15.544515 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:15.546119 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:15.546125 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:15.546127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:15.546315 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:15.546488 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:15.546489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:15.546489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:15.546545 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:15.546747 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:15.546752 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:15.546792 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.546842 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.546985 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":55,"thread_start_us":141,"threads_started":1}
I20260929 22:46:15.549057 19976 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:54948:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 22:46:15.549263 19976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:46:15.551038 20113 tablet_service.cc:1467] Processing CreateTablet for tablet 3b90f62b23be475ba9175a085ccef759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=54f8d5ad9ffd4f4da4773f3adfb36e7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:46:15.551061 20253 tablet_service.cc:1467] Processing CreateTablet for tablet 3b90f62b23be475ba9175a085ccef759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=54f8d5ad9ffd4f4da4773f3adfb36e7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:46:15.551210 20113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b90f62b23be475ba9175a085ccef759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.551239 20253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b90f62b23be475ba9175a085ccef759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.552558 20488 tablet_bootstrap.cc:492] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: Bootstrap starting.
I20260929 22:46:15.552654 20393 tablet_service.cc:1467] Processing CreateTablet for tablet 3b90f62b23be475ba9175a085ccef759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=54f8d5ad9ffd4f4da4773f3adfb36e7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 22:46:15.552806 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b90f62b23be475ba9175a085ccef759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.552982 20488 tablet_bootstrap.cc:654] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.553726 20488 tablet_bootstrap.cc:492] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: No bootstrap required, opened a new log
I20260929 22:46:15.553784 20488 ts_tablet_manager.cc:1397] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:15.553967 20488 raft_consensus.cc:348] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.554040 20488 raft_consensus.cc:374] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.554077 20488 raft_consensus.cc:729] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6cb8a9226a346149a189971b7519a60, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.554131 20488 consensus_queue.cc:260] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.554227 20488 ts_tablet_manager.cc:1428] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.554299 20495 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.554358 20489 tablet_bootstrap.cc:492] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: Bootstrap starting.
I20260929 22:46:15.554405 20495 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.554730 20489 tablet_bootstrap.cc:654] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.555032 20487 tablet_bootstrap.cc:492] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Bootstrap starting.
I20260929 22:46:15.555349 20489 tablet_bootstrap.cc:492] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: No bootstrap required, opened a new log
I20260929 22:46:15.555408 20489 ts_tablet_manager.cc:1397] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:15.555492 20487 tablet_bootstrap.cc:654] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.555539 20489 raft_consensus.cc:348] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.555608 20489 raft_consensus.cc:374] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.555652 20489 raft_consensus.cc:729] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.555699 20489 consensus_queue.cc:260] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.555792 20489 ts_tablet_manager.cc:1428] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:15.555809 20493 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.555882 20493 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.556155 20487 tablet_bootstrap.cc:492] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: No bootstrap required, opened a new log
I20260929 22:46:15.556207 20487 ts_tablet_manager.cc:1397] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:15.556365 20487 raft_consensus.cc:348] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.556453 20487 raft_consensus.cc:374] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.556488 20487 raft_consensus.cc:729] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ed862e3bb14aa98ac35b7fa6dab6c2, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.556541 20487 consensus_queue.cc:260] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.556625 20487 ts_tablet_manager.cc:1428] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.556699 20494 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.556808 20494 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.613288 20493 raft_consensus.cc:482] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:46:15.613384 20493 raft_consensus.cc:504] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.613523 20493 leader_election.cc:288] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.613781 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b90f62b23be475ba9175a085ccef759" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60" is_pre_election: true
I20260929 22:46:15.613801 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b90f62b23be475ba9175a085ccef759" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" is_pre_election: true
I20260929 22:46:15.613888 20413 raft_consensus.cc:2454] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.613888 20133 raft_consensus.cc:2454] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.614037 20205 leader_election.cc:302] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.614146 20493 raft_consensus.cc:2781] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:46:15.614188 20493 raft_consensus.cc:482] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:46:15.614216 20493 raft_consensus.cc:3037] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.614841 20493 raft_consensus.cc:504] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.614979 20493 leader_election.cc:288] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Requested vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.615167 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b90f62b23be475ba9175a085ccef759" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60"
I20260929 22:46:15.615180 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b90f62b23be475ba9175a085ccef759" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
I20260929 22:46:15.615255 20133 raft_consensus.cc:3037] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.615281 20413 raft_consensus.cc:3037] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.615935 20133 raft_consensus.cc:2454] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.615954 20413 raft_consensus.cc:2454] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.616114 20205 leader_election.cc:302] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.616233 20493 raft_consensus.cc:2781] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:15.616290 20493 raft_consensus.cc:686] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Becoming Leader. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Running, Role: LEADER
I20260929 22:46:15.616354 20493 consensus_queue.cc:237] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.616650 20497 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: TxnStatusTablet state changed. Reason: New leader f9cfaca854af4a17be8098e94d97bfe5. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.616748 20497 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:46:15.616946 20530 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 22:46:15.616968 19976 catalog_manager.cc:5495] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } health_report { overall_health: UNKNOWN } } }
I20260929 22:46:15.617074 20530 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 22:46:15.629539 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.627103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49418 (local address 127.12.27.130:42483)
0929 22:46:15.627164 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.627167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.627176 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:46:15.627240 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.627241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.627253 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.627308 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:15.627458 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.628031 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.628811 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.629024 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.629108 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.629273 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.629308 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.629374 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.629447 (+ 73us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.629468 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:46:15.629571 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.626975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:42483 (local address 127.0.0.1:49418)
0929 22:46:15.627072 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.627085 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.627162 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.627315 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.627315 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.627316 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:46:15.627367 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.627370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.628128 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.628130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.628722 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.628724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.629110 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.629111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.629167 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.629192 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.629394 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.629403 (+ 9us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.629446 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.629498 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 22:46:15.630492 20413 raft_consensus.cc:1261] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.630553 20133 raft_consensus.cc:1261] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.630694 20493 consensus_queue.cc:1035] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.630777 20497 consensus_queue.cc:1035] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.631330 20494 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: TxnStatusTablet state changed. Reason: New leader f9cfaca854af4a17be8098e94d97bfe5. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.631431 20494 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.631726 20495 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: TxnStatusTablet state changed. Reason: New leader f9cfaca854af4a17be8098e94d97bfe5. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.631806 20495 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.632097 20505 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.632184 20505 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:46:15.632226 20494 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.632244 20500 mvcc.cc:205] Tried to move back new op lower bound from 7334797212181032960 to 7334797212125040640. Current Snapshot: MvccSnapshot[applied={T|T < 7334797212181032960 or (T in {7334797212181032960})}]
I20260929 22:46:15.632289 20494 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P 29ed862e3bb14aa98ac35b7fa6dab6c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.633143 20493 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.633227 20493 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P f9cfaca854af4a17be8098e94d97bfe5: This TxnStatusTablet replica's current role is: LEADER
I20260929 22:46:15.633615 20495 tablet_replica.cc:439] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } } }
I20260929 22:46:15.633692 20495 tablet_replica.cc:442] T 3b90f62b23be475ba9175a085ccef759 P d6cb8a9226a346149a189971b7519a60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 22:46:15.636392 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.633864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57122 (local address 127.12.27.129:41845)
0929 22:46:15.633916 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.633918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.633925 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:46:15.633960 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.633961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.633980 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.634049 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:15.634167 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.634630 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.635698 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.635887 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.635938 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.636097 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.636192 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.636241 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.636303 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.636318 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:46:15.641250 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.638725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:55403 (local address 127.12.27.130:42483)
0929 22:46:15.638783 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.638785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.638908 (+ 123us) server_negotiation.cc:407] Connection header received
0929 22:46:15.638959 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.638960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.638968 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.639013 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:15.639160 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.639581 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.640664 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.640832 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.640886 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.641071 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.641094 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.641123 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.641190 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.641205 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:46:15.641338 20537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.638670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:42483 (local address 127.12.27.129:55403)
0929 22:46:15.638830 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.638842 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.638901 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.639029 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.639030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.639032 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:46:15.639104 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.639105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.639679 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.639680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.640588 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.640591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.640905 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.640906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.640973 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.640988 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.641139 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.641140 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.641188 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.641227 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260929 22:46:15.643311 20413 raft_consensus.cc:1261] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Refusing update from remote peer d6cb8a9226a346149a189971b7519a60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.643419 20273 raft_consensus.cc:1261] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Refusing update from remote peer d6cb8a9226a346149a189971b7519a60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.643535 20518 consensus_queue.cc:1035] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.643646 20495 consensus_queue.cc:1035] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.654490 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.648730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:58263 (local address 127.12.27.129:41845)
0929 22:46:15.648766 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.648768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.651837 (+ 3069us) server_negotiation.cc:407] Connection header received
0929 22:46:15.651863 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.651864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.651876 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.651943 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:15.652026 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.652746 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.653838 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.654029 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.654082 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.654267 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.654298 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.654345 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.654428 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.654443 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:46:15.654546 20541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.648660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41845 (local address 127.12.27.130:58263)
0929 22:46:15.651765 (+ 3105us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:15.651776 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:15.651828 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:15.651946 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:15.651947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:15.651948 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:46:15.651988 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.651989 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.652839 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.652840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.653753 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:15.653756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.654100 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.654101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:15.654156 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.654170 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.654364 (+ 194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.654366 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:46:15.654427 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 22:46:15.654467 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3064,"thread_start_us":75,"threads_started":1}
I20260929 22:46:15.664775 19976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:15.664891 19976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:15.665535 19976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Sending DeleteTablet for 3 replicas of tablet 7e7f9daa72c44d8fb84d029e95c5217e
I20260929 22:46:15.665757 20253 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e7f9daa72c44d8fb84d029e95c5217e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49406
I20260929 22:46:15.665805 20393 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e7f9daa72c44d8fb84d029e95c5217e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:38750
I20260929 22:46:15.665841 20511 tablet_replica.cc:330] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: stopping tablet replica
I20260929 22:46:15.665886 20511 raft_consensus.cc:2229] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:15.665917 20511 raft_consensus.cc:2258] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.665979 20512 tablet_replica.cc:330] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: stopping tablet replica
I20260929 22:46:15.666028 20512 raft_consensus.cc:2229] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:15.666059 20512 raft_consensus.cc:2258] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.666121 20113 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e7f9daa72c44d8fb84d029e95c5217e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:57120
I20260929 22:46:15.666201 20510 tablet_replica.cc:330] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: stopping tablet replica
I20260929 22:46:15.666240 20510 raft_consensus.cc:2229] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:46:15.666316 20510 raft_consensus.cc:2258] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.666530 20512 ts_tablet_manager.cc:1905] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.666616 20510 ts_tablet_manager.cc:1905] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.668489 20510 ts_tablet_manager.cc:1918] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:46:15.668548 20510 log.cc:1196] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/7e7f9daa72c44d8fb84d029e95c5217e
I20260929 22:46:15.668769 20510 ts_tablet_manager.cc:1939] T 7e7f9daa72c44d8fb84d029e95c5217e P d6cb8a9226a346149a189971b7519a60: Deleting consensus metadata
I20260929 22:46:15.669090 19961 catalog_manager.cc:4841] TS d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845): tablet 7e7f9daa72c44d8fb84d029e95c5217e (table test-table [id=0548a09fcd9146cdac5adde7f5054fca]) successfully deleted
I20260929 22:46:15.670325 20511 ts_tablet_manager.cc:1905] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.671810 20511 ts_tablet_manager.cc:1918] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:46:15.671870 20511 log.cc:1196] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/7e7f9daa72c44d8fb84d029e95c5217e
I20260929 22:46:15.671859 20512 ts_tablet_manager.cc:1918] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:46:15.671911 20512 log.cc:1196] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/7e7f9daa72c44d8fb84d029e95c5217e
I20260929 22:46:15.672083 20511 ts_tablet_manager.cc:1939] T 7e7f9daa72c44d8fb84d029e95c5217e P f9cfaca854af4a17be8098e94d97bfe5: Deleting consensus metadata
I20260929 22:46:15.672132 20512 ts_tablet_manager.cc:1939] T 7e7f9daa72c44d8fb84d029e95c5217e P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting consensus metadata
I20260929 22:46:15.672382 19962 catalog_manager.cc:4841] TS f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483): tablet 7e7f9daa72c44d8fb84d029e95c5217e (table test-table [id=0548a09fcd9146cdac5adde7f5054fca]) successfully deleted
I20260929 22:46:15.672442 19961 catalog_manager.cc:4841] TS 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055): tablet 7e7f9daa72c44d8fb84d029e95c5217e (table test-table [id=0548a09fcd9146cdac5adde7f5054fca]) successfully deleted
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:46:15.702301 20026 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:15.695338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54956 (local address 127.12.27.190:43177)
0929 22:46:15.695412 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.695414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.695598 (+ 184us) server_negotiation.cc:407] Connection header received
0929 22:46:15.695714 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.695715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.695728 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.695792 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.696550 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.697344 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.698422 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.698732 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.698806 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.702223 (+ 3417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54956: BlockingRecv error: recv got EOF from 127.0.0.1:54956 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 29 22:46:15 dist-test-slave-00d6 krb5kdc[19931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM
I20260929 22:46:15.712148 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.703047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54968 (local address 127.12.27.190:43177)
0929 22:46:15.703218 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.703220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.703520 (+ 300us) server_negotiation.cc:407] Connection header received
0929 22:46:15.703579 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.703580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.703590 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.703670 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:15.704291 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.705023 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.706063 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.706349 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.706458 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.709190 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:15.709192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:15.709192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:15.709200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:15.710873 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.711270 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.711271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.711271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.711329 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:15.711560 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:15.711561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:15.711561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:15.711725 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:15.711823 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.711981 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.712054 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260929 22:46:15.714155 19976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:46:15.714331 19976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:46:15.715837 20113 tablet_service.cc:1467] Processing CreateTablet for tablet 71e17e50346745bb9c3bd4a36cd13eb2 (DEFAULT_TABLE table=test-table [id=617e9c7e9e32402b950f4c34188a9a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.715970 20113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71e17e50346745bb9c3bd4a36cd13eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.717341 20488 tablet_bootstrap.cc:492] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Bootstrap starting.
I20260929 22:46:15.717751 20488 tablet_bootstrap.cc:654] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.718221 20393 tablet_service.cc:1467] Processing CreateTablet for tablet 71e17e50346745bb9c3bd4a36cd13eb2 (DEFAULT_TABLE table=test-table [id=617e9c7e9e32402b950f4c34188a9a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.718340 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71e17e50346745bb9c3bd4a36cd13eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.719607 20487 tablet_bootstrap.cc:492] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Bootstrap starting.
I20260929 22:46:15.720093 20487 tablet_bootstrap.cc:654] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.721035 20488 tablet_bootstrap.cc:492] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: No bootstrap required, opened a new log
I20260929 22:46:15.721088 20488 ts_tablet_manager.cc:1397] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260929 22:46:15.721040 20253 tablet_service.cc:1467] Processing CreateTablet for tablet 71e17e50346745bb9c3bd4a36cd13eb2 (DEFAULT_TABLE table=test-table [id=617e9c7e9e32402b950f4c34188a9a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.721230 20488 raft_consensus.cc:348] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.721308 20488 raft_consensus.cc:374] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.721321 20253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71e17e50346745bb9c3bd4a36cd13eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.721328 20488 raft_consensus.cc:729] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6cb8a9226a346149a189971b7519a60, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.721369 20488 consensus_queue.cc:260] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.721452 20488 ts_tablet_manager.cc:1428] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.722293 20487 tablet_bootstrap.cc:492] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: No bootstrap required, opened a new log
I20260929 22:46:15.722342 20487 ts_tablet_manager.cc:1397] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 22:46:15.722489 20487 raft_consensus.cc:348] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.722553 20487 raft_consensus.cc:374] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.722571 20487 raft_consensus.cc:729] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ed862e3bb14aa98ac35b7fa6dab6c2, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.722609 20487 consensus_queue.cc:260] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.722651 20489 tablet_bootstrap.cc:492] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Bootstrap starting.
I20260929 22:46:15.722690 20487 ts_tablet_manager.cc:1428] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.722965 20489 tablet_bootstrap.cc:654] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.723766 20489 tablet_bootstrap.cc:492] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: No bootstrap required, opened a new log
I20260929 22:46:15.723819 20489 ts_tablet_manager.cc:1397] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:15.723933 20489 raft_consensus.cc:348] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.724004 20489 raft_consensus.cc:374] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.724025 20489 raft_consensus.cc:729] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.724064 20489 consensus_queue.cc:260] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.724146 20489 ts_tablet_manager.cc:1428] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.898923 20497 raft_consensus.cc:482] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:46:15.899019 20497 raft_consensus.cc:504] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.899194 20497 leader_election.cc:288] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.899459 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71e17e50346745bb9c3bd4a36cd13eb2" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60" is_pre_election: true
I20260929 22:46:15.899539 20133 raft_consensus.cc:2454] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.899485 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71e17e50346745bb9c3bd4a36cd13eb2" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" is_pre_election: true
I20260929 22:46:15.899626 20413 raft_consensus.cc:2454] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.899721 20205 leader_election.cc:302] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6cb8a9226a346149a189971b7519a60, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.899824 20497 raft_consensus.cc:2781] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:46:15.899863 20497 raft_consensus.cc:482] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:46:15.899907 20497 raft_consensus.cc:3037] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.900578 20497 raft_consensus.cc:504] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.900704 20497 leader_election.cc:288] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Requested vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.900875 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71e17e50346745bb9c3bd4a36cd13eb2" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
I20260929 22:46:15.900906 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71e17e50346745bb9c3bd4a36cd13eb2" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60"
I20260929 22:46:15.900972 20413 raft_consensus.cc:3037] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.900967 20133 raft_consensus.cc:3037] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.901698 20413 raft_consensus.cc:2454] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.901819 20133 raft_consensus.cc:2454] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.901846 20205 leader_election.cc:302] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.901940 20497 raft_consensus.cc:2781] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:15.901996 20497 raft_consensus.cc:686] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Becoming Leader. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Running, Role: LEADER
I20260929 22:46:15.902045 20497 consensus_queue.cc:237] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.902595 19976 catalog_manager.cc:5495] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } health_report { overall_health: UNKNOWN } } }
I20260929 22:46:15.907918 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:15.905828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49432 (local address 127.12.27.130:42483)
0929 22:46:15.905870 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:15.905872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:15.905913 (+ 41us) server_negotiation.cc:407] Connection header received
0929 22:46:15.905979 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:15.905980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:15.905992 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:15.906050 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:15.906158 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.906608 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.907276 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:15.907459 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:15.907509 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:15.907689 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:15.907719 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:15.907766 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:15.907823 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 22:46:15.907836 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:46:15.908545 20413 raft_consensus.cc:1261] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.908545 20133 raft_consensus.cc:1261] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:15.908772 20505 consensus_queue.cc:1035] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.908862 20497 consensus_queue.cc:1035] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:15.910063 20502 mvcc.cc:205] Tried to move back new op lower bound from 7334797213319933952 to 7334797213295185920. Current Snapshot: MvccSnapshot[applied={T|T < 7334797213319933952}]
I20260929 22:46:15.911052 19975 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:15.911135 19975 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:15.911702 19975 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Sending DeleteTablet for 3 replicas of tablet 71e17e50346745bb9c3bd4a36cd13eb2
I20260929 22:46:15.911954 20113 tablet_service.cc:1514] Processing DeleteTablet for tablet 71e17e50346745bb9c3bd4a36cd13eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:57120
I20260929 22:46:15.911996 20253 tablet_service.cc:1514] Processing DeleteTablet for tablet 71e17e50346745bb9c3bd4a36cd13eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49406
I20260929 22:46:15.912045 20393 tablet_service.cc:1514] Processing DeleteTablet for tablet 71e17e50346745bb9c3bd4a36cd13eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:15 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:38750
I20260929 22:46:15.912066 20510 tablet_replica.cc:330] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: stopping tablet replica
I20260929 22:46:15.912082 20511 tablet_replica.cc:330] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: stopping tablet replica
I20260929 22:46:15.912117 20512 tablet_replica.cc:330] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: stopping tablet replica
I20260929 22:46:15.912127 20510 raft_consensus.cc:2229] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:15.912127 20511 raft_consensus.cc:2229] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:46:15.912159 20512 raft_consensus.cc:2229] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:15.912166 20510 raft_consensus.cc:2258] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.912176 20511 raft_consensus.cc:2258] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.912201 20512 raft_consensus.cc:2258] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:15.912451 20512 ts_tablet_manager.cc:1905] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.912500 20511 ts_tablet_manager.cc:1905] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.912566 20510 ts_tablet_manager.cc:1905] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:15.913790 20512 ts_tablet_manager.cc:1918] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:15.913830 20512 log.cc:1196] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/71e17e50346745bb9c3bd4a36cd13eb2
I20260929 22:46:15.913941 19975 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 22:46:15.914042 20512 ts_tablet_manager.cc:1939] T 71e17e50346745bb9c3bd4a36cd13eb2 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting consensus metadata
I20260929 22:46:15.914060 20510 ts_tablet_manager.cc:1918] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:15.914067 20511 ts_tablet_manager.cc:1918] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260929 22:46:15.914088 19975 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:46:15.914108 20510 log.cc:1196] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/71e17e50346745bb9c3bd4a36cd13eb2
I20260929 22:46:15.914127 20511 log.cc:1196] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/71e17e50346745bb9c3bd4a36cd13eb2
I20260929 22:46:15.914315 20510 ts_tablet_manager.cc:1939] T 71e17e50346745bb9c3bd4a36cd13eb2 P d6cb8a9226a346149a189971b7519a60: Deleting consensus metadata
I20260929 22:46:15.914348 20511 ts_tablet_manager.cc:1939] T 71e17e50346745bb9c3bd4a36cd13eb2 P f9cfaca854af4a17be8098e94d97bfe5: Deleting consensus metadata
I20260929 22:46:15.914345 19961 catalog_manager.cc:4841] TS 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055): tablet 71e17e50346745bb9c3bd4a36cd13eb2 (table test-table [id=617e9c7e9e32402b950f4c34188a9a7f]) successfully deleted
I20260929 22:46:15.914675 19961 catalog_manager.cc:4841] TS d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845): tablet 71e17e50346745bb9c3bd4a36cd13eb2 (table test-table [id=617e9c7e9e32402b950f4c34188a9a7f]) successfully deleted
I20260929 22:46:15.914984 19962 catalog_manager.cc:4841] TS f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483): tablet 71e17e50346745bb9c3bd4a36cd13eb2 (table test-table [id=617e9c7e9e32402b950f4c34188a9a7f]) successfully deleted
I20260929 22:46:15.915213 20393 tablet_service.cc:1467] Processing CreateTablet for tablet ffc7598a96f44ee09174420e95832d97 (DEFAULT_TABLE table=test-table [id=f621663753a445b7a01ddda348a7e676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.915216 20113 tablet_service.cc:1467] Processing CreateTablet for tablet ffc7598a96f44ee09174420e95832d97 (DEFAULT_TABLE table=test-table [id=f621663753a445b7a01ddda348a7e676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.915316 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffc7598a96f44ee09174420e95832d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.915321 20113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffc7598a96f44ee09174420e95832d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.916216 20488 tablet_bootstrap.cc:492] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: Bootstrap starting.
I20260929 22:46:15.916229 20487 tablet_bootstrap.cc:492] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Bootstrap starting.
I20260929 22:46:15.916545 20488 tablet_bootstrap.cc:654] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.916900 20487 tablet_bootstrap.cc:654] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.917142 20488 tablet_bootstrap.cc:492] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: No bootstrap required, opened a new log
I20260929 22:46:15.917196 20488 ts_tablet_manager.cc:1397] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 22:46:15.917306 20488 raft_consensus.cc:348] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.917387 20488 raft_consensus.cc:374] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.917418 20488 raft_consensus.cc:729] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6cb8a9226a346149a189971b7519a60, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.917398 20253 tablet_service.cc:1467] Processing CreateTablet for tablet ffc7598a96f44ee09174420e95832d97 (DEFAULT_TABLE table=test-table [id=f621663753a445b7a01ddda348a7e676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:15.917460 20488 consensus_queue.cc:260] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.917493 20253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffc7598a96f44ee09174420e95832d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:15.917565 20488 ts_tablet_manager.cc:1428] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:15.917577 20487 tablet_bootstrap.cc:492] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: No bootstrap required, opened a new log
I20260929 22:46:15.917615 20487 ts_tablet_manager.cc:1397] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:15.917754 20487 raft_consensus.cc:348] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.917831 20487 raft_consensus.cc:374] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.917853 20487 raft_consensus.cc:729] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ed862e3bb14aa98ac35b7fa6dab6c2, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.917901 20487 consensus_queue.cc:260] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.918008 20487 ts_tablet_manager.cc:1428] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:15.918638 20489 tablet_bootstrap.cc:492] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Bootstrap starting.
I20260929 22:46:15.918939 20489 tablet_bootstrap.cc:654] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:15.919402 20489 tablet_bootstrap.cc:492] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: No bootstrap required, opened a new log
I20260929 22:46:15.919464 20489 ts_tablet_manager.cc:1397] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:15.919576 20489 raft_consensus.cc:348] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.919687 20489 raft_consensus.cc:374] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:15.919716 20489 raft_consensus.cc:729] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Initialized, Role: FOLLOWER
I20260929 22:46:15.919770 20489 consensus_queue.cc:260] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.919869 20489 ts_tablet_manager.cc:1428] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:15.985261 20493 raft_consensus.cc:482] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:46:15.985357 20493 raft_consensus.cc:504] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.985567 20493 leader_election.cc:288] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.985905 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffc7598a96f44ee09174420e95832d97" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60" is_pre_election: true
I20260929 22:46:15.986027 20133 raft_consensus.cc:2454] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.985976 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffc7598a96f44ee09174420e95832d97" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" is_pre_election: true
I20260929 22:46:15.986096 20413 raft_consensus.cc:2454] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 0.
I20260929 22:46:15.986227 20205 leader_election.cc:302] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6cb8a9226a346149a189971b7519a60, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.986335 20493 raft_consensus.cc:2781] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:46:15.986406 20493 raft_consensus.cc:482] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:46:15.986441 20493 raft_consensus.cc:3037] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.987092 20493 raft_consensus.cc:504] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.987226 20493 leader_election.cc:288] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Requested vote from peers d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845), 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055)
I20260929 22:46:15.987392 20133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffc7598a96f44ee09174420e95832d97" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6cb8a9226a346149a189971b7519a60"
I20260929 22:46:15.987407 20413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffc7598a96f44ee09174420e95832d97" candidate_uuid: "f9cfaca854af4a17be8098e94d97bfe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2"
I20260929 22:46:15.987474 20413 raft_consensus.cc:3037] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.987474 20133 raft_consensus.cc:3037] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:15.988252 20413 raft_consensus.cc:2454] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.988252 20133 raft_consensus.cc:2454] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9cfaca854af4a17be8098e94d97bfe5 in term 1.
I20260929 22:46:15.988454 20205 leader_election.cc:302] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ed862e3bb14aa98ac35b7fa6dab6c2, f9cfaca854af4a17be8098e94d97bfe5; no voters:
I20260929 22:46:15.988556 20493 raft_consensus.cc:2781] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:15.988611 20493 raft_consensus.cc:686] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Becoming Leader. State: Replica: f9cfaca854af4a17be8098e94d97bfe5, State: Running, Role: LEADER
I20260929 22:46:15.988659 20493 consensus_queue.cc:237] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } }
I20260929 22:46:15.989233 19975 catalog_manager.cc:5495] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "f9cfaca854af4a17be8098e94d97bfe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9cfaca854af4a17be8098e94d97bfe5" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 } health_report { overall_health: UNKNOWN } } }
I20260929 22:46:16.015759 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:16.013617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:57555 (local address 127.12.27.130:42483)
0929 22:46:16.013675 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:16.013677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:16.013685 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:16.013736 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:16.013737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:16.013745 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:16.013791 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:16.013867 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:16.014325 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:16.015160 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:16.015337 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:16.015402 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:16.015512 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:16.015537 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:16.015576 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:16.015670 (+ 94us) server_negotiation.cc:299] Negotiation successful
0929 22:46:16.015689 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:46:16.015762 20541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:16.013553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:42483 (local address 127.12.27.130:57555)
0929 22:46:16.013618 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:16.013630 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:16.013676 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:16.013794 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:16.013795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:16.013796 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 22:46:16.013833 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:16.013834 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:16.014386 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:16.014386 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:16.014928 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:16.014930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:16.015413 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:16.015414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:16.015450 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:16.015455 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 22:46:16.015589 (+ 134us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 22:46:16.015590 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 22:46:16.015659 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:46:16.015708 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 22:46:16.017649 20413 raft_consensus.cc:1261] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:16.017653 20133 raft_consensus.cc:1261] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Refusing update from remote peer f9cfaca854af4a17be8098e94d97bfe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:16.017858 20493 consensus_queue.cc:1035] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6cb8a9226a346149a189971b7519a60" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:16.018014 20505 consensus_queue.cc:1035] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ed862e3bb14aa98ac35b7fa6dab6c2" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:16.027680 19975 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:16.027786 19975 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:16.028350 19975 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bff057208ba64a0786305f281f99d6f3: Sending DeleteTablet for 3 replicas of tablet ffc7598a96f44ee09174420e95832d97
I20260929 22:46:16.028597 20253 tablet_service.cc:1514] Processing DeleteTablet for tablet ffc7598a96f44ee09174420e95832d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:16 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49406
I20260929 22:46:16.028606 20113 tablet_service.cc:1514] Processing DeleteTablet for tablet ffc7598a96f44ee09174420e95832d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:16 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:57120
I20260929 22:46:16.028626 20393 tablet_service.cc:1514] Processing DeleteTablet for tablet ffc7598a96f44ee09174420e95832d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:16 UTC) from {username='oryx', principal='oryx/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:38750
I20260929 22:46:16.028698 20510 tablet_replica.cc:330] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: stopping tablet replica
I20260929 22:46:16.028697 20511 tablet_replica.cc:330] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: stopping tablet replica
I20260929 22:46:16.028703 20512 tablet_replica.cc:330] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: stopping tablet replica
I20260929 22:46:16.028743 20512 raft_consensus.cc:2229] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:16.028751 20510 raft_consensus.cc:2229] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:16.028744 20511 raft_consensus.cc:2229] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:46:16.028786 20510 raft_consensus.cc:2258] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:16.028787 20512 raft_consensus.cc:2258] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:16.028826 20511 raft_consensus.cc:2258] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:16.029141 20510 ts_tablet_manager.cc:1905] T ffc7598a96f44ee09174420e95832d97 P d6cb8a9226a346149a189971b7519a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:16.029248 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20048
I20260929 22:46:16.029269 20511 ts_tablet_manager.cc:1905] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:16.030889 20511 ts_tablet_manager.cc:1918] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:46:16.030967 20511 log.cc:1196] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/ffc7598a96f44ee09174420e95832d97
I20260929 22:46:16.031178 20511 ts_tablet_manager.cc:1939] T ffc7598a96f44ee09174420e95832d97 P f9cfaca854af4a17be8098e94d97bfe5: Deleting consensus metadata
I20260929 22:46:16.031515 19962 catalog_manager.cc:4841] TS f9cfaca854af4a17be8098e94d97bfe5 (127.12.27.130:42483): tablet ffc7598a96f44ee09174420e95832d97 (table test-table [id=f621663753a445b7a01ddda348a7e676]) successfully deleted
W20260929 22:46:16.035868 19961 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:41845 (error 108)
I20260929 22:46:16.036136 20512 ts_tablet_manager.cc:1905] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:16.036430 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20188
I20260929 22:46:16.036543 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:16.036324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41845 (local address 127.0.0.1:57132)
0929 22:46:16.036433 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:16.036496 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:41845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
W20260929 22:46:16.037380 19961 catalog_manager.cc:4584] TS d6cb8a9226a346149a189971b7519a60 (127.12.27.129:41845): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffc7598a96f44ee09174420e95832d97: Network error: Client connection negotiation failed: client connection to 127.12.27.129:41845: connect: Connection refused (error 111)
I20260929 22:46:16.037883 20512 ts_tablet_manager.cc:1918] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 22:46:16.037948 20512 log.cc:1196] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/ffc7598a96f44ee09174420e95832d97
I20260929 22:46:16.038157 20512 ts_tablet_manager.cc:1939] T ffc7598a96f44ee09174420e95832d97 P 29ed862e3bb14aa98ac35b7fa6dab6c2: Deleting consensus metadata
I20260929 22:46:16.038861 19961 catalog_manager.cc:4841] TS 29ed862e3bb14aa98ac35b7fa6dab6c2 (127.12.27.131:38055): tablet ffc7598a96f44ee09174420e95832d97 (table test-table [id=f621663753a445b7a01ddda348a7e676]) successfully deleted
I20260929 22:46:16.043066 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20328
I20260929 22:46:16.047830 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 19944
2026-09-29T22:46:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2814 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:46:16 dist-test-slave-00d6 krb5kdc[20575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:46:16 dist-test-slave-00d6 krb5kdc[20575](info): set up 2 sockets
Sep 29 22:46:16 dist-test-slave-00d6 krb5kdc[20575](info): commencing operation
krb5kdc: starting...
W20260929 22:46:17.088658 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:46:17 dist-test-slave-00d6 krb5kdc[20575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:46:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:46:17.204133 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:36147
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:36147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:17.282389 20588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:17.282629 20588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:17.282668 20588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:17.283859 20588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:17.283934 20588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:17.283958 20588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:17.283985 20588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:17.284014 20588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:17.285445 20588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:36147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:36147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:17.285712 20588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:17.285944 20588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:17.290645 20593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:17.290642 20596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:17.290853 20594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:17.290920 20588 server_base.cc:1034] running on GCE node
I20260929 22:46:17.291160 20588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:17.291465 20588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:17.292626 20588 hybrid_clock.cc:648] HybridClock initialized: now 1790721977292595 us; error 47 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-29T22:46:17Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1252 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:46:17 dist-test-slave-00d6 krb5kdc[20601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:46:17 dist-test-slave-00d6 krb5kdc[20601](info): set up 2 sockets
Sep 29 22:46:17 dist-test-slave-00d6 krb5kdc[20601](info): commencing operation
krb5kdc: starting...
W20260929 22:46:18.344673 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:46:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:46:18.463788 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39705
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:39705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:18.543090 20614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:18.543349 20614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:18.543385 20614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:18.544574 20614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:18.544647 20614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:18.544672 20614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:18.544699 20614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:18.544731 20614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:18.546187 20614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:39705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:18.546459 20614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:18.546689 20614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:18.551548 20619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:18.551585 20620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:18.551540 20622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:18.551851 20614 server_base.cc:1034] running on GCE node
I20260929 22:46:18.552294 20614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:18.552577 20614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:18.553730 20614 hybrid_clock.cc:648] HybridClock initialized: now 1790721978553711 us; error 38 us; skew 500 ppm
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:18.556325 20614 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:46:18.556757 20614 webserver.cc:460] Webserver started at http://127.12.27.190:38633/ using document root <none> and password file <none>
I20260929 22:46:18.557018 20614 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:18.557088 20614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:18.557262 20614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:18.558488 20614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "5f8ea6ebf66d4427a38127904e5b56be"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "22209a0fb68b31aded60af4ceff16200"
server_key_iv: "3648b023ef6d27526234fee56345c0f8"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.558842 20614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "5f8ea6ebf66d4427a38127904e5b56be"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "22209a0fb68b31aded60af4ceff16200"
server_key_iv: "3648b023ef6d27526234fee56345c0f8"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.560262 20614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:18.560956 20629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.561125 20614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:46:18.561249 20614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "5f8ea6ebf66d4427a38127904e5b56be"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "22209a0fb68b31aded60af4ceff16200"
server_key_iv: "3648b023ef6d27526234fee56345c0f8"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.561329 20614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:18.577360 20614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:18.580457 20614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:18.580618 20614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:18.585548 20614 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:39705
I20260929 22:46:18.585599 20681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:39705 every 8 connection(s)
I20260929 22:46:18.585930 20614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:46:18.586767 20682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:18.588331 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20614
I20260929 22:46:18.588451 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:46:18.588647 12398 external_mini_cluster.cc:1428] Setting key 080ab0259ca11b87c74a8566c5db482a
I20260929 22:46:18.589468 20682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Bootstrap starting.
I20260929 22:46:18.590171 20682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:18.590490 20682 log.cc:824] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:18.591179 20682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: No bootstrap required, opened a new log
I20260929 22:46:18.593426 20682 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:18.593592 20682 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:18.593626 20682 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f8ea6ebf66d4427a38127904e5b56be, State: Initialized, Role: FOLLOWER
I20260929 22:46:18.593748 20682 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:18.593883 20682 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:46:18.593955 20682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:46:18.594012 20682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:18.594662 20682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:18.594786 20682 leader_election.cc:302] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f8ea6ebf66d4427a38127904e5b56be; no voters:
I20260929 22:46:18.594998 20682 leader_election.cc:288] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:46:18.595031 20687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:18.595185 20687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 LEADER]: Becoming Leader. State: Replica: 5f8ea6ebf66d4427a38127904e5b56be, State: Running, Role: LEADER
I20260929 22:46:18.595268 20687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:18.595299 20682 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: configured and running, proceeding with master startup.
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:46:18.597132 20689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f8ea6ebf66d4427a38127904e5b56be. Latest consensus state: current_term: 1 leader_uuid: "5f8ea6ebf66d4427a38127904e5b56be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } } }
I20260929 22:46:18.597277 20688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f8ea6ebf66d4427a38127904e5b56be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } } }
W20260929 22:46:18.597575 20701 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260929 22:46:18.598098 20689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: This master's current role is: LEADER
W20260929 22:46:18.598127 20701 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:46:18.598110 20688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:18.598302 20704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:46:18.598489 20704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:46:18.600078 20704 catalog_manager.cc:1347] Generated new cluster ID: 4be612eb199b4c81941a693fee2b559e
I20260929 22:46:18.600178 20704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:46:18.600651 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:18.589258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55960 (local address 127.12.27.190:39705)
0929 22:46:18.589452 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:18.589462 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:18.589494 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:46:18.590037 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:18.590046 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:18.590106 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:18.590265 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:18.590980 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.592380 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.593134 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.593740 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.593859 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:18.596701 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:18.596705 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:18.596705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:18.596717 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:18.598977 (+ 2260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:18.599393 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:18.599396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:18.599396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:18.599499 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:18.599757 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:18.599758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:18.599759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:18.600070 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:18.600208 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:18.600344 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 22:46:18.600494 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260929 22:46:18.627701 20704 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:46:18.628247 20704 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:46:18.641553 20704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Generated new TSK 0
I20260929 22:46:18.641774 20704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:46:18.676204 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39705
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:18.772053 20708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:18.772250 20708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:18.772280 20708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:18.773398 20708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:18.773434 20708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:18.773459 20708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:46:18.774778 20708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:18.774955 20708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:18.775143 20708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:18.779970 20716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:18.779922 20713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:18.779927 20714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:18.780215 20708 server_base.cc:1034] running on GCE node
I20260929 22:46:18.780437 20708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:18.780669 20708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:18.781852 20708 hybrid_clock.cc:648] HybridClock initialized: now 1790721978781835 us; error 28 us; skew 500 ppm
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:18.784328 20708 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:46:18.784740 20708 webserver.cc:460] Webserver started at http://127.12.27.129:45897/ using document root <none> and password file <none>
I20260929 22:46:18.784960 20708 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:18.785027 20708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:18.785184 20708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:18.786209 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "a5ed6f5775794f9db7cd5dd965dfb3c1"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "92daf8abf60a8cc58c6375048344d1f4"
server_key_iv: "450d43567fb61eed60d18efda63784e4"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.786580 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "a5ed6f5775794f9db7cd5dd965dfb3c1"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "92daf8abf60a8cc58c6375048344d1f4"
server_key_iv: "450d43567fb61eed60d18efda63784e4"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.787981 20708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:46:18.788684 20723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.788950 20708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:18.789055 20708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "a5ed6f5775794f9db7cd5dd965dfb3c1"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "92daf8abf60a8cc58c6375048344d1f4"
server_key_iv: "450d43567fb61eed60d18efda63784e4"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.789136 20708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:18.800819 20708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:18.802580 20708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:18.802736 20708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:18.802956 20708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:18.803251 20708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:18.803303 20708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.803344 20708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:18.803373 20708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.809276 20708 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:43815
I20260929 22:46:18.809311 20836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:43815 every 8 connection(s)
I20260929 22:46:18.809628 20708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:46:18.811329 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20708
I20260929 22:46:18.811415 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:46:18.811604 12398 external_mini_cluster.cc:1428] Setting key b8f0d281dc20a6efa6495f2ea96efbde
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:46:18.819708 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:18.810350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:59323 (local address 127.12.27.190:39705)
0929 22:46:18.810396 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:18.810398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:18.810605 (+ 207us) server_negotiation.cc:407] Connection header received
0929 22:46:18.811063 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:18.811064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:18.811074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:18.811126 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:18.812257 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.813052 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.814138 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.814371 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.814458 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:18.816849 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:18.816850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:18.816851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:18.816859 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:18.818284 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:18.818697 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:18.818698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:18.818699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:18.818763 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:18.819012 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:18.819013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:18.819013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:18.819131 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:18.819211 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:18.819488 (+ 277us) server_negotiation.cc:299] Negotiation successful
0929 22:46:18.819574 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:46:18.819926 20839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:18.810333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:59323)
0929 22:46:18.810485 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:18.810521 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:18.810981 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:18.811179 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:18.811182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:18.811949 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:18.812156 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:18.812161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.813151 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.813152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:18.814031 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:18.814034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.814466 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.814467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:18.814584 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:18.815106 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:18.815114 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:18.816735 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:18.818370 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:18.818377 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:18.818380 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:18.818605 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:18.818839 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:18.818839 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:18.818840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:18.818945 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:18.819201 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:18.819206 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:18.819350 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 22:46:18.819468 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 22:46:18.819626 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":92,"threads_started":1}
I20260929 22:46:18.820449 20837 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39705
I20260929 22:46:18.820559 20837 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:18.820752 20837 heartbeater.cc:511] Master 127.12.27.190:39705 requested a full tablet report, sending...
I20260929 22:46:18.821233 20646 ts_manager.cc:194] Registered new tserver with Master: a5ed6f5775794f9db7cd5dd965dfb3c1 (127.12.27.129:43815)
I20260929 22:46:18.821846 20646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:59323
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:46:18.839567 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39705
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:18.919554 20842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:18.919763 20842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:18.919786 20842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:18.920862 20842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:18.920899 20842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:18.920924 20842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:46:18.922243 20842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:18.922420 20842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:18.922583 20842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:18.927417 20850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:18.927424 20848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:18.927563 20842 server_base.cc:1034] running on GCE node
W20260929 22:46:18.927377 20847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:18.927947 20842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:18.928194 20842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:18.929337 20842 hybrid_clock.cc:648] HybridClock initialized: now 1790721978929323 us; error 29 us; skew 500 ppm
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:18.931861 20842 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:46:18.932320 20842 webserver.cc:460] Webserver started at http://127.12.27.130:38237/ using document root <none> and password file <none>
I20260929 22:46:18.932542 20842 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:18.932608 20842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:18.932822 20842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:18.933967 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "c920d205dd5546ae91511e904e58ef3c"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "59ae2bd484741b7df13a0632b583b2f4"
server_key_iv: "0551fd28ce88d82794bd95daf4077d0d"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.934343 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "c920d205dd5546ae91511e904e58ef3c"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "59ae2bd484741b7df13a0632b583b2f4"
server_key_iv: "0551fd28ce88d82794bd95daf4077d0d"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.935775 20842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:18.936506 20857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.936669 20842 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:46:18.936774 20842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "c920d205dd5546ae91511e904e58ef3c"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "59ae2bd484741b7df13a0632b583b2f4"
server_key_iv: "0551fd28ce88d82794bd95daf4077d0d"
server_key_version: "encryptionkey@0"
I20260929 22:46:18.936856 20842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:18.954933 20842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:18.956876 20842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:18.957041 20842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:18.957291 20842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:18.957587 20842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:18.957643 20842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.957683 20842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:18.957719 20842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:18.963575 20842 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:42501
I20260929 22:46:18.963651 20970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:42501 every 8 connection(s)
I20260929 22:46:18.963968 20842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:46:18.964342 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20842
I20260929 22:46:18.964478 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:46:18.964684 12398 external_mini_cluster.cc:1428] Setting key 738401feae5e3157db102c189fa998de
Sep 29 22:46:18 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
I20260929 22:46:18.973796 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:18.964676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:60129 (local address 127.12.27.190:39705)
0929 22:46:18.964718 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:18.964720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:18.965071 (+ 351us) server_negotiation.cc:407] Connection header received
0929 22:46:18.965757 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:18.965758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:18.965770 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:18.965830 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:18.966876 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.967361 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.968520 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.968734 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.968822 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:18.970961 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:18.970963 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:18.970963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:18.970971 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:18.972444 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:18.972941 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:18.972942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:18.972942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:18.972990 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:18.973203 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:18.973203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:18.973204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:18.973301 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:18.973349 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:18.973663 (+ 314us) server_negotiation.cc:299] Negotiation successful
0929 22:46:18.973730 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:46:18.973954 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:18.964684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:60129)
0929 22:46:18.964896 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:18.964993 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:18.965637 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:18.965891 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:18.965894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:18.966484 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:18.966762 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:18.966771 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.967452 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.967454 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:18.968412 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:18.968415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:18.968831 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:18.968832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:18.968967 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:18.969517 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:18.969525 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:18.970864 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:18.972551 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:18.972557 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:18.972560 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:18.972870 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:18.973051 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:18.973052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:18.973052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:18.973149 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:18.973356 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:18.973361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:18.973518 (+ 157us) client_negotiation.cc:769] Sending connection context
0929 22:46:18.973615 (+ 97us) client_negotiation.cc:240] Negotiation successful
0929 22:46:18.973738 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":110,"threads_started":1}
I20260929 22:46:18.974391 20971 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39705
I20260929 22:46:18.974493 20971 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:18.974699 20971 heartbeater.cc:511] Master 127.12.27.190:39705 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
I20260929 22:46:18.975132 20646 ts_manager.cc:194] Registered new tserver with Master: c920d205dd5546ae91511e904e58ef3c (127.12.27.130:42501)
I20260929 22:46:18.975693 20646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:60129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:46:18.990023 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39705
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:19.071027 20976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:19.071231 20976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:19.071254 20976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:19.072419 20976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:19.072460 20976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:19.072486 20976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:46:19.073839 20976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:19.074064 20976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:19.074234 20976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:19.079098 20984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.079078 20982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.079142 20976 server_base.cc:1034] running on GCE node
W20260929 22:46:19.079097 20981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.079589 20976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:19.079897 20976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:19.081066 20976 hybrid_clock.cc:648] HybridClock initialized: now 1790721979081052 us; error 22 us; skew 500 ppm
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721979, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:19.083534 20976 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:46:19.083983 20976 webserver.cc:460] Webserver started at http://127.12.27.131:42509/ using document root <none> and password file <none>
I20260929 22:46:19.084219 20976 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:19.084286 20976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:19.084439 20976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:19.085441 20976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "ee5914f6fc2545d6a0b0818856ab0456"
format_stamp: "Formatted at 2026-09-29 22:46:19 on dist-test-slave-00d6"
server_key: "630cea8cf583171937a3173006cfdd00"
server_key_iv: "9a457ee57cac5dd32482a8d67e7b4207"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.085793 20976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "ee5914f6fc2545d6a0b0818856ab0456"
format_stamp: "Formatted at 2026-09-29 22:46:19 on dist-test-slave-00d6"
server_key: "630cea8cf583171937a3173006cfdd00"
server_key_iv: "9a457ee57cac5dd32482a8d67e7b4207"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.087060 20976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:46:19.087791 20991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.087949 20976 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.088043 20976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "ee5914f6fc2545d6a0b0818856ab0456"
format_stamp: "Formatted at 2026-09-29 22:46:19 on dist-test-slave-00d6"
server_key: "630cea8cf583171937a3173006cfdd00"
server_key_iv: "9a457ee57cac5dd32482a8d67e7b4207"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.088128 20976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:19.111199 20976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:19.113219 20976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:19.113402 20976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:19.113651 20976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:19.113981 20976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:19.114038 20976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.114084 20976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:19.114109 20976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.119910 20976 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:35931
I20260929 22:46:19.119957 21104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:35931 every 8 connection(s)
I20260929 22:46:19.120306 20976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:46:19.124651 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 20976
I20260929 22:46:19.124747 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:46:19.124913 12398 external_mini_cluster.cc:1428] Setting key 4926c0a6dfa93d331d893d1a2ce5f72a
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721979, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:46:19.129622 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.121073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:54151 (local address 127.12.27.190:39705)
0929 22:46:19.121143 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.121146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.121369 (+ 223us) server_negotiation.cc:407] Connection header received
0929 22:46:19.121924 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.121925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.121939 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.121991 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.122929 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.123435 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.124619 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.124902 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.124988 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.127232 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:19.127233 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:19.127233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:19.127240 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:19.128494 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:19.128842 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:19.128843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:19.128843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:19.128903 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:19.129115 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:19.129115 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:19.129116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:19.129211 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:19.129260 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:19.129492 (+ 232us) server_negotiation.cc:299] Negotiation successful
0929 22:46:19.129558 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:46:19.129776 21107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.121085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:54151)
0929 22:46:19.121248 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.121283 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.121800 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.122065 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.122068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.122633 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.122822 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.122827 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.123537 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.123538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.124522 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.124525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.124999 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.125000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.125128 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.125745 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.125755 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.127145 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:19.128561 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:19.128567 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:19.128569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:19.128778 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:19.128960 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:19.128961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:19.128961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:19.129054 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:19.129263 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:19.129266 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:19.129386 (+ 120us) client_negotiation.cc:769] Sending connection context
0929 22:46:19.129467 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:46:19.129578 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260929 22:46:19.130259 21105 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39705
I20260929 22:46:19.130362 21105 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:19.130539 21105 heartbeater.cc:511] Master 127.12.27.190:39705 requested a full tablet report, sending...
I20260929 22:46:19.130900 20646 ts_manager.cc:194] Registered new tserver with Master: ee5914f6fc2545d6a0b0818856ab0456 (127.12.27.131:35931)
I20260929 22:46:19.131263 20646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:54151
I20260929 22:46:19.136536 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab.
Entry for principal oryx/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab.
WARNING: no policy specified for oryx/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab.
Entry for principal oryx/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab.
WARNING: no policy specified for oryx/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab.
Entry for principal oryx/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab.
I20260929 22:46:19.210505 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20708
I20260929 22:46:19.214779 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20842
I20260929 22:46:19.219015 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20976
I20260929 22:46:19.223093 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 20614
I20260929 22:46:19.228058 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39705
--webserver_interface=127.12.27.190
--webserver_port=38633
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:39705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:19.316555 21114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:19.316774 21114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:19.316799 21114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:19.318066 21114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:19.318113 21114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:19.318130 21114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:19.318189 21114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:19.318210 21114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:19.319902 21114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:39705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=38633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:19.320171 21114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:19.320447 21114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:19.325590 21122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.325721 21114 server_base.cc:1034] running on GCE node
W20260929 22:46:19.325661 21120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.325590 21119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.326107 21114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:19.326409 21114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:19.327596 21114 hybrid_clock.cc:648] HybridClock initialized: now 1790721979327576 us; error 37 us; skew 500 ppm
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721979, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:19.330140 21114 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:46:19.330574 21114 webserver.cc:460] Webserver started at http://127.12.27.190:38633/ using document root <none> and password file <none>
I20260929 22:46:19.330812 21114 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:19.330899 21114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:19.332252 21114 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:19.332933 21129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.333112 21114 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:19.333209 21114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "5f8ea6ebf66d4427a38127904e5b56be"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "22209a0fb68b31aded60af4ceff16200"
server_key_iv: "3648b023ef6d27526234fee56345c0f8"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.333604 21114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:19.358187 21114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:19.360778 21114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:19.360950 21114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:19.364907 21114 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:39705
I20260929 22:46:19.364945 21181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:39705 every 8 connection(s)
I20260929 22:46:19.365330 21114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:46:19.366797 21182 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:46:19.367391 21182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Bootstrap starting.
I20260929 22:46:19.372990 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21114
I20260929 22:46:19.373293 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:43815
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:39705
--webserver_port=45897
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:46:19.375566 21182 log.cc:824] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:19.377244 21182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:46:19.377548 21182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Bootstrap complete.
I20260929 22:46:19.379868 21182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:19.380101 21182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f8ea6ebf66d4427a38127904e5b56be, State: Initialized, Role: FOLLOWER
I20260929 22:46:19.380264 21182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:19.380335 21182 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:46:19.380400 21182 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:46:19.380450 21182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:46:19.381453 21182 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:19.381541 21182 leader_election.cc:302] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f8ea6ebf66d4427a38127904e5b56be; no voters:
I20260929 22:46:19.381736 21182 leader_election.cc:288] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:46:19.381776 21186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:46:19.381933 21186 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [term 2 LEADER]: Becoming Leader. State: Replica: 5f8ea6ebf66d4427a38127904e5b56be, State: Running, Role: LEADER
I20260929 22:46:19.382020 21182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:46:19.382077 21186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } }
I20260929 22:46:19.382397 21186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f8ea6ebf66d4427a38127904e5b56be. Latest consensus state: current_term: 2 leader_uuid: "5f8ea6ebf66d4427a38127904e5b56be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } } }
I20260929 22:46:19.382579 21186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:19.382390 21188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5f8ea6ebf66d4427a38127904e5b56be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f8ea6ebf66d4427a38127904e5b56be" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39705 } } }
I20260929 22:46:19.382894 21188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:19.382902 21196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:46:19.383487 21196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:46:19.383775 21196 catalog_manager.cc:1259] Loaded cluster ID: 4be612eb199b4c81941a693fee2b559e
I20260929 22:46:19.383891 21196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:46:19.384681 21196 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:46:19.384886 21196 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5f8ea6ebf66d4427a38127904e5b56be: Loaded TSK: 0
I20260929 22:46:19.385097 21196 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:46:19.477246 21184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:19.477497 21184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:19.477555 21184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:19.478833 21184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:19.478875 21184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:19.478904 21184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:46:19.480527 21184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.129.keytab
--principal=oryx/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:43815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=45897
--tserver_master_addrs=127.12.27.190:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:19.480777 21184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:19.481040 21184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:19.486681 21211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.486761 21208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.486683 21209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.487084 21184 server_base.cc:1034] running on GCE node
I20260929 22:46:19.487308 21184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:19.487569 21184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:19.488756 21184 hybrid_clock.cc:648] HybridClock initialized: now 1790721979488738 us; error 32 us; skew 500 ppm
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721979, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:19.491422 21184 init.cc:377] Logged in from keytab as oryx/127.12.27.129@KRBTEST.COM (short username oryx)
I20260929 22:46:19.491961 21184 webserver.cc:460] Webserver started at http://127.12.27.129:45897/ using document root <none> and password file <none>
I20260929 22:46:19.492203 21184 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:19.492300 21184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:19.493815 21184 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:19.494481 21218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.494685 21184 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:46:19.494778 21184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "a5ed6f5775794f9db7cd5dd965dfb3c1"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "92daf8abf60a8cc58c6375048344d1f4"
server_key_iv: "450d43567fb61eed60d18efda63784e4"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.495195 21184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:19.509699 21184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:19.512514 21184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:19.512717 21184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:19.513015 21184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:19.513340 21184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:19.513396 21184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.513430 21184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:19.513473 21184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.519567 21184 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:43815
I20260929 22:46:19.519613 21331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:43815 every 8 connection(s)
I20260929 22:46:19.520004 21184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.528620 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21184
I20260929 22:46:19.528934 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:42501
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:39705
--webserver_port=38237
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:46:19.529557 21334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.520804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:51101)
0929 22:46:19.520989 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.521041 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.521663 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.522142 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.522146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.522857 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.523121 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.523127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.524240 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.524241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.525479 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.525482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.526037 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.526038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.526170 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.526713 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.526723 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.529344 (+ 2621us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":75,"threads_started":1}
W20260929 22:46:19.529795 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.521107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:51101 (local address 127.12.27.190:39705)
0929 22:46:19.521290 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.521297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.521326 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:46:19.521891 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.521897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.521940 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.522049 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.523239 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.524160 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.525561 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.525958 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.526041 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.529481 (+ 3440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:51101: BlockingRecv error: recv got EOF from 127.12.27.129:51101 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
W20260929 22:46:19.529927 21332 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:39705 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.27.190:39705: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.534745 21334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.530127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:35039)
0929 22:46:19.530209 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.530220 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.530261 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.530449 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.530450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.530615 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.530668 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.530670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.531587 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.531588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.532137 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.532139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.532530 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.532531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.532603 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.533067 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.533076 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.534666 (+ 1590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":67}
W20260929 22:46:19.534796 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.530206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:35039 (local address 127.12.27.190:39705)
0929 22:46:19.530239 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.530240 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.530248 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:19.530339 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.530340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.530354 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.530388 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.530751 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.531486 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.532237 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.532445 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.532530 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.534737 (+ 2207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:35039: BlockingRecv error: recv got EOF from 127.12.27.129:35039 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.539589 21334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.535123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:48961)
0929 22:46:19.535177 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.535189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.535231 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.535375 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.535376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.535477 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.535502 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.535503 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.536456 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.536457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.536953 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.536955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.537464 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.537465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.537501 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.537932 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.537937 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.539520 (+ 1583us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 22:46:19.539691 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.535187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:48961 (local address 127.12.27.190:39705)
0929 22:46:19.535248 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.535251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.535260 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:46:19.535284 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.535285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.535295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.535368 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.535569 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.536368 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.537025 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.537355 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.537445 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.539597 (+ 2152us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:48961: BlockingRecv error: recv got EOF from 127.12.27.129:48961 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 22:46:19.539852 21332 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:46:19.611294 21336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:19.611521 21336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:19.611558 21336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:19.612766 21336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:19.612811 21336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:19.612838 21336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:46:19.614259 21336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.130.keytab
--principal=oryx/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:42501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=38237
--tserver_master_addrs=127.12.27.190:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:19.614440 21336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:19.614606 21336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:19.619724 21342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.619742 21344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.619741 21341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.619854 21336 server_base.cc:1034] running on GCE node
I20260929 22:46:19.620116 21336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:19.620302 21336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:19.621434 21336 hybrid_clock.cc:648] HybridClock initialized: now 1790721979621424 us; error 29 us; skew 500 ppm
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721979, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:19.623891 21336 init.cc:377] Logged in from keytab as oryx/127.12.27.130@KRBTEST.COM (short username oryx)
I20260929 22:46:19.624249 21336 webserver.cc:460] Webserver started at http://127.12.27.130:38237/ using document root <none> and password file <none>
I20260929 22:46:19.624428 21336 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:19.624478 21336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:19.625718 21336 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:19.626243 21351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.626410 21336 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:19.626506 21336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "c920d205dd5546ae91511e904e58ef3c"
format_stamp: "Formatted at 2026-09-29 22:46:18 on dist-test-slave-00d6"
server_key: "59ae2bd484741b7df13a0632b583b2f4"
server_key_iv: "0551fd28ce88d82794bd95daf4077d0d"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.626844 21336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:19.656478 21336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:19.658924 21336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:19.659093 21336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:19.659340 21336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:19.659699 21336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:19.659752 21336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.659795 21336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:19.659834 21336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.665581 21336 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:42501
I20260929 22:46:19.665627 21464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:42501 every 8 connection(s)
I20260929 22:46:19.665998 21336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.672871 21467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.666724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:56923)
0929 22:46:19.666906 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.666948 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.667421 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.667636 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.667639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.668195 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.668382 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.668387 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.669011 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.669011 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.669773 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.669775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.670089 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.670090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.670191 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.670652 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.670659 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.672733 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":108,"threads_started":1}
W20260929 22:46:19.672860 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.666750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:56923 (local address 127.12.27.190:39705)
0929 22:46:19.666824 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.666826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.667034 (+ 208us) server_negotiation.cc:407] Connection header received
0929 22:46:19.667501 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.667502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.667515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.667571 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.668461 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.668936 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.669847 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.670019 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.670068 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.672815 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:56923: BlockingRecv error: recv got EOF from 127.12.27.130:56923 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260929 22:46:19.673110 21465 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:39705 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.27.190:39705: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
I20260929 22:46:19.674531 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21336
I20260929 22:46:19.674800 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:35931
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:39705
--webserver_port=42509
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.677561 21467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.673315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:34297)
0929 22:46:19.673438 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.673446 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.673484 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.673600 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.673601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.673704 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.673742 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.673743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.674294 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.674295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.674821 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.674822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.675230 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.675231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.675294 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.675726 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.675731 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.677464 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102}
W20260929 22:46:19.677578 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.673392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:34297 (local address 127.12.27.190:39705)
0929 22:46:19.673446 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.673448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.673474 (+ 26us) server_negotiation.cc:407] Connection header received
0929 22:46:19.673530 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.673531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.673538 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.673585 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.673796 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.674235 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.674902 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.675161 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.675232 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.677539 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:34297: BlockingRecv error: recv got EOF from 127.12.27.130:34297 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.682557 21467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.678058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:43561)
0929 22:46:19.678098 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.678108 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.678139 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.678308 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.678309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.678476 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.678510 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.678512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.679074 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.679075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.679983 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.679986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.680297 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.680298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.680362 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.680714 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.680720 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.682487 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 22:46:19.682592 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.678116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:43561 (local address 127.12.27.190:39705)
0929 22:46:19.678175 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.678177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.678197 (+ 20us) server_negotiation.cc:407] Connection header received
0929 22:46:19.678218 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.678219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.678229 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.678293 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.678590 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.679005 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.680062 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.680225 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.680276 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.682537 (+ 2261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:43561: BlockingRecv error: recv got EOF from 127.12.27.130:43561 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260929 22:46:19.683010 21465 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:46:19.755942 21468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:19.756147 21468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:19.756170 21468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:19.757350 21468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:19.757393 21468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:19.757445 21468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:46:19.758881 21468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/krb5kdc/oryx_127.12.27.131.keytab
--principal=oryx/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:35931
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=42509
--tserver_master_addrs=127.12.27.190:39705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:19.759126 21468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:19.759351 21468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:19.764251 21476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.764290 21474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:19.764278 21473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:19.764456 21468 server_base.cc:1034] running on GCE node
I20260929 22:46:19.764647 21468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:19.764840 21468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:19.766016 21468 hybrid_clock.cc:648] HybridClock initialized: now 1790721979766002 us; error 24 us; skew 500 ppm
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721979, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:19.768515 21468 init.cc:377] Logged in from keytab as oryx/127.12.27.131@KRBTEST.COM (short username oryx)
I20260929 22:46:19.769107 21468 webserver.cc:460] Webserver started at http://127.12.27.131:42509/ using document root <none> and password file <none>
I20260929 22:46:19.769345 21468 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:19.769433 21468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:19.770757 21468 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:19.771385 21483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.771677 21468 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:19.771790 21468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "ee5914f6fc2545d6a0b0818856ab0456"
format_stamp: "Formatted at 2026-09-29 22:46:19 on dist-test-slave-00d6"
server_key: "630cea8cf583171937a3173006cfdd00"
server_key_iv: "9a457ee57cac5dd32482a8d67e7b4207"
server_key_version: "encryptionkey@0"
I20260929 22:46:19.772161 21468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:19.796958 21468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:19.799163 21468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:19.799360 21468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:19.799610 21468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:19.799992 21468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:19.800028 21468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.800050 21468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:19.800062 21468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:19.805845 21468 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:35931
I20260929 22:46:19.805899 21596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:35931 every 8 connection(s)
I20260929 22:46:19.806280 21468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:46:19.810043 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21468
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.813751 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.806935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:33857)
0929 22:46:19.807095 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.807134 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.807614 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.807896 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.807899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.808438 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.808631 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.808636 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.809285 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.809285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.810068 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.810070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.810743 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.810744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.810873 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.811355 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.811363 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.813600 (+ 2237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
W20260929 22:46:19.813773 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.806965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:33857 (local address 127.12.27.190:39705)
0929 22:46:19.807011 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.807013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.807201 (+ 188us) server_negotiation.cc:407] Connection header received
0929 22:46:19.807785 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.807787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.807796 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.807839 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.808709 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.809184 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.810312 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.810636 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.810725 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.813703 (+ 2978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:33857: BlockingRecv error: recv got EOF from 127.12.27.131:33857 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:46:19.814020 21597 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:39705 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.27.190:39705: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
I20260929 22:46:19.817692 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.810562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55966 (local address 127.12.27.190:39705)
0929 22:46:19.810672 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.810674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.810682 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:19.810745 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.810746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.810756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.810836 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.811416 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.811956 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.812806 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.813050 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.813133 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.814606 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:19.814610 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:19.814610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:19.814619 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:19.816327 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:19.816713 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:19.816715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:19.816716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:19.816799 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:19.817006 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:19.817007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:19.817008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:19.817223 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:19.817366 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:19.817488 (+ 122us) server_negotiation.cc:299] Negotiation successful
0929 22:46:19.817595 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":44,"threads_started":1}
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.818799 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.814289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:57305)
0929 22:46:19.814335 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.814344 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.814378 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.814484 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.814485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.814629 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.814669 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.814670 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.815491 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.815492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.816063 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.816065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.816544 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.816545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.816623 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.817020 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.817024 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.818760 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 22:46:19.818866 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.814337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:57305 (local address 127.12.27.190:39705)
0929 22:46:19.814381 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.814383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.814390 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:46:19.814426 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.814427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.814434 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.814478 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.814733 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.815394 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.816142 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.816469 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.816523 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.818830 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:57305: BlockingRecv error: recv got EOF from 127.12.27.131:57305 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:19 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:19.822489 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:19.819065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:48419)
0929 22:46:19.819157 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:19.819166 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:19.819215 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:19.819306 (+ 91us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:19.819306 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:19.819405 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:19.819428 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.819428 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.820003 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.820004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.820451 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:19.820452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.820737 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.820738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:19.820773 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.821068 (+ 295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:19.821071 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:19.822450 (+ 1379us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
W20260929 22:46:19.822552 21335 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:19.819122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:48419 (local address 127.12.27.190:39705)
0929 22:46:19.819159 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:19.819161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:19.819203 (+ 42us) server_negotiation.cc:407] Connection header received
0929 22:46:19.819249 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:19.819250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:19.819256 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:19.819303 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:19.819482 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.819942 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.820513 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:19.820679 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:19.820723 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:19.822518 (+ 1795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:48419: BlockingRecv error: recv got EOF from 127.12.27.131:48419 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 22:46:19.822659 21597 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 29 22:46:20 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:20 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:20.545126 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:20.540294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:54997)
0929 22:46:20.540428 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:20.540446 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:20.540496 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:20.540658 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:20.540658 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:20.540822 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:20.540874 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:20.540876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.541512 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.541513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:20.542047 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:20.542049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.542374 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.542375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:20.542415 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:20.542855 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:20.542859 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:20.545016 (+ 2157us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
W20260929 22:46:20.545172 21603 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:20.540383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:54997 (local address 127.12.27.190:39705)
0929 22:46:20.540523 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:20.540525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:20.540533 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:20.540558 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:20.540558 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:20.540570 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:20.540640 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:20.540945 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.541442 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.542119 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.542304 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.542353 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:20.545099 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:54997: BlockingRecv error: recv got EOF from 127.12.27.129:54997 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
Sep 29 22:46:20 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:20 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:20.688158 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:20.683396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:39875)
0929 22:46:20.683546 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:20.683566 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:20.683667 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:20.683811 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:20.683811 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:20.683962 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:20.684010 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:20.684011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.684848 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.684849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:20.685434 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:20.685437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.685763 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.685764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:20.685809 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:20.686300 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:20.686304 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:20.688093 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
W20260929 22:46:20.688288 21603 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:20.683461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:39875 (local address 127.12.27.190:39705)
0929 22:46:20.683556 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:20.683558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:20.683654 (+ 96us) server_negotiation.cc:407] Connection header received
0929 22:46:20.683725 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:20.683725 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:20.683736 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:20.683792 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:20.684075 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.684759 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.685507 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.685691 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.685744 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:20.688188 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:39875: BlockingRecv error: recv got EOF from 127.12.27.130:39875 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Sep 29 22:46:20 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:20 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:20.828090 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:20.823236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:32783)
0929 22:46:20.823428 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:20.823443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:20.823525 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:20.823714 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:20.823715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:20.823898 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:20.823944 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:20.823946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.824612 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.824613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:20.825229 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:20.825231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.825594 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.825595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:20.825659 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:20.826133 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:20.826138 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:20.828019 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
W20260929 22:46:20.828181 21603 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:20.823360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:32783 (local address 127.12.27.190:39705)
0929 22:46:20.823458 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:20.823460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:20.823525 (+ 65us) server_negotiation.cc:407] Connection header received
0929 22:46:20.823602 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:20.823603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:20.823617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:20.823707 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:20.824028 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.824525 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.825309 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:20.825505 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:20.825592 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:20.828114 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:32783: BlockingRecv error: recv got EOF from 127.12.27.131:32783 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 29 22:46:21 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:21 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:21.550122 21606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:21.545742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:38573)
0929 22:46:21.545908 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:21.545918 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:21.545970 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:21.546113 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:21.546113 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:21.546272 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:21.546322 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:21.546323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.546946 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.546947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:21.547455 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:21.547457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.547792 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.547794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:21.547837 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:21.548371 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:21.548376 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:21.550063 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
W20260929 22:46:21.550241 21607 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:21.545811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:38573 (local address 127.12.27.190:39705)
0929 22:46:21.545970 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:21.545971 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:21.546006 (+ 35us) server_negotiation.cc:407] Connection header received
0929 22:46:21.546029 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:21.546029 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:21.546040 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:21.546090 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:21.546401 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.546880 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.547529 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.547729 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.547778 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:21.550147 (+ 2369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:38573: BlockingRecv error: recv got EOF from 127.12.27.129:38573 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
Sep 29 22:46:21 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:21 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:21.693265 21608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:21.688658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:32817)
0929 22:46:21.688834 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:21.688847 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:21.688934 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:21.689089 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:21.689089 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:21.689259 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:21.689321 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:21.689323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.690042 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.690043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:21.690565 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:21.690566 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.690936 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.690937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:21.691000 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:21.691446 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:21.691451 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:21.693207 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":87,"threads_started":1}
W20260929 22:46:21.693393 21607 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:21.688745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:32817 (local address 127.12.27.190:39705)
0929 22:46:21.688819 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:21.688822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:21.688921 (+ 99us) server_negotiation.cc:407] Connection header received
0929 22:46:21.689010 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:21.689011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:21.689023 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:21.689084 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:21.689426 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.689957 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.690652 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.690845 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.690936 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:21.693317 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:32817: BlockingRecv error: recv got EOF from 127.12.27.130:32817 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 29 22:46:21 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:21 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:21.833438 21609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:21.828549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:43849)
0929 22:46:21.828702 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:21.828771 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:21.828850 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:21.829033 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:21.829034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:21.829221 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:21.829270 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:21.829272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.830071 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.830072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:21.830645 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:21.830647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.831031 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.831032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:21.831091 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:21.831575 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:21.831580 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:21.833379 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":58,"threads_started":1}
W20260929 22:46:21.833572 21607 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:21.828720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:43849 (local address 127.12.27.190:39705)
0929 22:46:21.828795 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:21.828797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:21.828828 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:46:21.828934 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:21.828935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:21.828949 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:21.829026 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:21.829353 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.829969 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.830737 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:21.830939 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:21.831030 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:21.833463 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:43849: BlockingRecv error: recv got EOF from 127.12.27.131:43849 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 29 22:46:22 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:22 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:22.561633 21610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:22.550687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:50573)
0929 22:46:22.550867 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:22.550888 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:22.550952 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:22.551108 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:22.551109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:22.551277 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:22.551325 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:22.551326 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.552015 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.552016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:22.552558 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:22.552560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.553014 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.553016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:22.553068 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:22.559492 (+ 6424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:22.559498 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:22.561571 (+ 2073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":84,"threads_started":1}
W20260929 22:46:22.561806 21611 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:22.550753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:50573 (local address 127.12.27.190:39705)
0929 22:46:22.550926 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:22.550928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:22.550938 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:22.551017 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:22.551017 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:22.551028 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:22.551089 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:22.551394 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.551936 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.552645 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.552904 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.552965 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:22.561727 (+ 8762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:50573: BlockingRecv error: recv got EOF from 127.12.27.129:50573 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
Sep 29 22:46:22 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:22 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:22.698465 21612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:22.693682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:36501)
0929 22:46:22.693848 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:22.693860 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:22.693949 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:22.694107 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:22.694108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:22.694286 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:22.694331 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:22.694333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.695031 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.695032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:22.695556 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:22.695558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.695958 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.695959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:22.696016 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:22.696534 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:22.696538 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:22.698407 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":90,"threads_started":1}
W20260929 22:46:22.698817 21611 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:22.693763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:36501 (local address 127.12.27.190:39705)
0929 22:46:22.693836 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:22.693838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:22.693932 (+ 94us) server_negotiation.cc:407] Connection header received
0929 22:46:22.694011 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:22.694012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:22.694028 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:22.694095 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:22.694438 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.694946 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.695675 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.695878 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.695959 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:22.698738 (+ 2779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:36501: BlockingRecv error: recv got EOF from 127.12.27.130:36501 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 29 22:46:22 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:22 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:22.838603 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:22.833962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:48531)
0929 22:46:22.834113 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:22.834130 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:22.834188 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:22.834338 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:22.834339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:22.834506 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:22.834553 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:22.834554 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.835224 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.835225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:22.835769 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:22.835772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.836114 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.836115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:22.836157 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:22.836660 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:22.836664 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:22.838543 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
W20260929 22:46:22.838707 21611 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:22.834048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:48531 (local address 127.12.27.190:39705)
0929 22:46:22.834134 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:22.834136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:22.834188 (+ 52us) server_negotiation.cc:407] Connection header received
0929 22:46:22.834258 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:22.834259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:22.834273 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:22.834320 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:22.834647 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.835148 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.835835 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:22.836037 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:22.836092 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:22.838637 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:48531: BlockingRecv error: recv got EOF from 127.12.27.131:48531 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Sep 29 22:46:23 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:23 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:23.567049 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:23.562170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:49801)
0929 22:46:23.562370 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:23.562382 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:23.562442 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:23.562596 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:23.562597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:23.562781 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:23.562828 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:23.562830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.563750 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.563751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:23.564349 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:23.564352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.564696 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.564697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:23.564737 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:23.565193 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:23.565197 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:23.566991 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":103,"threads_started":1}
W20260929 22:46:23.567199 21615 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:23.562300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:49801 (local address 127.12.27.190:39705)
0929 22:46:23.562458 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:23.562460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:23.562470 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:23.562504 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:23.562505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:23.562515 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:23.562574 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:23.562965 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.563679 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.564447 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.564632 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.564681 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:23.567108 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:49801: BlockingRecv error: recv got EOF from 127.12.27.129:49801 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
Sep 29 22:46:23 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:23 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:23.703564 21616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:23.698900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:36343)
0929 22:46:23.699032 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:23.699043 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:23.699108 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:23.699320 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:23.699321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:23.699485 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:23.699547 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:23.699548 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.700180 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.700181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:23.700757 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:23.700760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.701087 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.701088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:23.701132 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:23.701628 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:23.701632 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:23.703465 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":56,"threads_started":1}
W20260929 22:46:23.703701 21615 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:23.698952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:36343 (local address 127.12.27.190:39705)
0929 22:46:23.699051 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:23.699053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:23.699111 (+ 58us) server_negotiation.cc:407] Connection header received
0929 22:46:23.699228 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:23.699229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:23.699247 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:23.699297 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:23.699613 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.700109 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.700835 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.701017 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.701068 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:23.703568 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:36343: BlockingRecv error: recv got EOF from 127.12.27.130:36343 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Sep 29 22:46:23 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:23 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:23.843449 21617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:23.839129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:40647)
0929 22:46:23.839274 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:23.839289 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:23.839343 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:23.839481 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:23.839481 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:23.839659 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:23.839707 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:23.839709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.840347 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.840348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:23.840866 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:23.840869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.841199 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.841200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:23.841238 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:23.841709 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:23.841714 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:23.843392 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
W20260929 22:46:23.843587 21615 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:23.839181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:40647 (local address 127.12.27.190:39705)
0929 22:46:23.839252 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:23.839254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:23.839343 (+ 89us) server_negotiation.cc:407] Connection header received
0929 22:46:23.839404 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:23.839405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:23.839418 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:23.839462 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:23.839773 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.840277 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.840946 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:23.841131 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:23.841186 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:23.843506 (+ 2320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:40647: BlockingRecv error: recv got EOF from 127.12.27.131:40647 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 29 22:46:24 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:24 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:24.572302 21618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:24.567548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:51189)
0929 22:46:24.567738 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:24.567752 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:24.567821 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:24.568044 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:24.568045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:24.568213 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:24.568262 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:24.568263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.568945 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.568947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:24.569490 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:24.569492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.569810 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.569811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:24.569858 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:24.570337 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:24.570342 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:24.572238 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":134,"threads_started":1}
W20260929 22:46:24.572461 21619 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:24.567714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:51189 (local address 127.12.27.190:39705)
0929 22:46:24.567906 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:24.567908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:24.567918 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:24.567944 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:24.567944 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:24.567954 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:24.568029 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:24.568348 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.568860 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.569561 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.569746 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.569796 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:24.572330 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:51189: BlockingRecv error: recv got EOF from 127.12.27.129:51189 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":69,"threads_started":1}
Sep 29 22:46:24 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:24 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:24.708732 21620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:24.704007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:40461)
0929 22:46:24.704146 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:24.704180 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:24.704243 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:24.704443 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:24.704444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:24.704623 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:24.704669 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:24.704671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.705357 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.705358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:24.705888 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:24.705890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.706315 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.706316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:24.706377 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:24.706829 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:24.706834 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:24.708637 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
W20260929 22:46:24.708768 21619 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:24.704130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:40461 (local address 127.12.27.190:39705)
0929 22:46:24.704207 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:24.704209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:24.704222 (+ 13us) server_negotiation.cc:407] Connection header received
0929 22:46:24.704323 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:24.704324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:24.704336 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:24.704429 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:24.704760 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.705263 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.705982 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.706221 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.706313 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:24.708710 (+ 2397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:40461: BlockingRecv error: recv got EOF from 127.12.27.130:40461 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 29 22:46:24 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:24 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:24.848623 21621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:24.844014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:37455)
0929 22:46:24.844160 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:24.844175 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:24.844262 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:24.844397 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:24.844398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:24.844595 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:24.844640 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:24.844643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.845336 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.845337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:24.845866 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:24.845868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.846258 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.846259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:24.846325 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:24.846754 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:24.846759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:24.848526 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
W20260929 22:46:24.848671 21619 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:24.844064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:37455 (local address 127.12.27.190:39705)
0929 22:46:24.844113 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:24.844115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:24.844244 (+ 129us) server_negotiation.cc:407] Connection header received
0929 22:46:24.844320 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:24.844321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:24.844336 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:24.844383 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:24.844728 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.845240 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.845972 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:24.846172 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:24.846257 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:24.848605 (+ 2348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:37455: BlockingRecv error: recv got EOF from 127.12.27.131:37455 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Sep 29 22:46:25 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:25 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:25.577796 21622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:25.572819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:54433)
0929 22:46:25.572997 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:25.573022 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:25.573101 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:25.573233 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:25.573235 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:25.573410 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:25.573458 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:25.573460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.574104 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.574105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:25.574736 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:25.574739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.575124 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.575125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:25.575167 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:25.575857 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:25.575861 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:25.577737 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":95,"threads_started":1}
W20260929 22:46:25.577940 21623 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:25.572905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:54433 (local address 127.12.27.190:39705)
0929 22:46:25.573027 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:25.573029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:25.573099 (+ 70us) server_negotiation.cc:407] Connection header received
0929 22:46:25.573146 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:25.573146 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:25.573156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:25.573214 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:25.573523 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.574012 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.574837 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.575055 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.575107 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:25.577826 (+ 2719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:54433: BlockingRecv error: recv got EOF from 127.12.27.129:54433 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":65,"threads_started":1}
Sep 29 22:46:25 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:25 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:25.714205 21624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:25.709323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:32907)
0929 22:46:25.709453 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:25.709491 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:25.709581 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:25.709735 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:25.709735 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:25.709910 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:25.709956 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:25.709957 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.710621 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.710622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:25.711138 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:25.711139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.711569 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.711571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:25.711675 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:25.712256 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:25.712261 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:25.714144 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
W20260929 22:46:25.714275 21623 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:25.709395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:32907 (local address 127.12.27.190:39705)
0929 22:46:25.709461 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:25.709463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:25.709561 (+ 98us) server_negotiation.cc:407] Connection header received
0929 22:46:25.709658 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:25.709659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:25.709671 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:25.709728 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:25.710034 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.710537 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.711233 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.711463 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.711533 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:25.714229 (+ 2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:32907: BlockingRecv error: recv got EOF from 127.12.27.130:32907 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 29 22:46:25 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:25 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:25.854117 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:25.849234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:35083)
0929 22:46:25.849422 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:25.849436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:25.849523 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:25.849684 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:25.849685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:25.849870 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:25.849915 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:25.849917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.850603 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.850604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:25.851131 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:25.851133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.851508 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.851510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:25.851572 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:25.852212 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:25.852218 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:25.854021 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":132,"threads_started":1}
W20260929 22:46:25.854161 21623 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:25.849429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:35083 (local address 127.12.27.190:39705)
0929 22:46:25.849500 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:25.849502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:25.849512 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:25.849590 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:25.849591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:25.849605 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:25.849679 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:25.850007 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.850507 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.851219 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:25.851415 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:25.851507 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:25.854099 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:35083: BlockingRecv error: recv got EOF from 127.12.27.131:35083 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 29 22:46:26 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:26 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:26.584796 21626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:26.578324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:55493)
0929 22:46:26.578471 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:26.578484 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:26.578556 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:26.578751 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:26.578752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:26.578977 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:26.579044 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:26.579047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.580196 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.580198 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:26.581128 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:26.581131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.581680 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.581682 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:26.581746 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:26.582338 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:26.582343 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:26.584701 (+ 2358us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
W20260929 22:46:26.584910 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:26.578399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:55493 (local address 127.12.27.190:39705)
0929 22:46:26.578520 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:26.578522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:26.578541 (+ 19us) server_negotiation.cc:407] Connection header received
0929 22:46:26.578628 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:26.578628 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:26.578642 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:26.578724 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:26.579154 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.580080 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.581227 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.581572 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.581679 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:26.584822 (+ 3143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:55493: BlockingRecv error: recv got EOF from 127.12.27.129:55493 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
Sep 29 22:46:26 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:26 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:26.719882 21628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:26.714758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:35225)
0929 22:46:26.714923 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:26.714938 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:26.714996 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:26.715130 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:26.715130 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:26.715302 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:26.715361 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:26.715363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.716017 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.716018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:26.716548 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:26.716550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.716937 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.716938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:26.716999 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:26.717821 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:26.717826 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:26.719823 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
W20260929 22:46:26.720033 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:26.714842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:35225 (local address 127.12.27.190:39705)
0929 22:46:26.714926 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:26.714928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:26.714993 (+ 65us) server_negotiation.cc:407] Connection header received
0929 22:46:26.715057 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:26.715058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:26.715068 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:26.715114 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:26.715425 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.715943 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.716651 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.716857 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.716920 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:26.719937 (+ 3017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:35225: BlockingRecv error: recv got EOF from 127.12.27.130:35225 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 29 22:46:26 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:26 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:26.859792 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:26.854661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:44771)
0929 22:46:26.854835 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:26.854847 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:26.854902 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:26.855052 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:26.855053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:26.855215 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:26.855271 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:26.855273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.855986 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.855987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:26.856521 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:26.856523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.856921 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.856922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:26.856975 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:26.857455 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:26.857459 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:26.859680 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
W20260929 22:46:26.859980 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:26.854805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:44771 (local address 127.12.27.190:39705)
0929 22:46:26.854871 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:26.854873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:26.854888 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:46:26.854953 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:26.854954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:26.854967 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:26.855034 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:26.855337 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.855905 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.856603 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:26.856826 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:26.856889 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:26.859772 (+ 2883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:44771: BlockingRecv error: recv got EOF from 127.12.27.131:44771 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 29 22:46:27 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:27 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:27.597599 21630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:27.585266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:59377)
0929 22:46:27.585476 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:27.585487 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:27.585537 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:27.585652 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:27.585652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:27.585862 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:27.585911 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:27.585912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.586616 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.586617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:27.587150 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:27.587152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.587505 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.587506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:27.587545 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:27.595538 (+ 7993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:27.595544 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:27.597528 (+ 1984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":125,"threads_started":1}
W20260929 22:46:27.597810 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:27.585425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:59377 (local address 127.12.27.190:39705)
0929 22:46:27.585546 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:27.585548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:27.585556 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:27.585579 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:27.585580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:27.585589 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:27.585647 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:27.586007 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.586536 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.587233 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.587432 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.587489 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:27.597649 (+ 10160us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:59377: BlockingRecv error: recv got EOF from 127.12.27.129:59377 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
Sep 29 22:46:27 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:27 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:27.725683 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:27.720447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:56493)
0929 22:46:27.720581 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:27.720591 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:27.720649 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:27.720794 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:27.720795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:27.720957 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:27.721007 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:27.721009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.721809 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.721810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:27.722363 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:27.722365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.722709 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.722709 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:27.722752 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:27.723280 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:27.723285 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:27.725551 (+ 2266us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
W20260929 22:46:27.725714 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:27.720504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:56493 (local address 127.12.27.190:39705)
0929 22:46:27.720586 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:27.720588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:27.720657 (+ 69us) server_negotiation.cc:407] Connection header received
0929 22:46:27.720702 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:27.720703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:27.720715 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:27.720769 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:27.721075 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.721713 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.722448 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.722637 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.722691 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:27.725642 (+ 2951us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:56493: BlockingRecv error: recv got EOF from 127.12.27.130:56493 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 29 22:46:27 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:27 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:27.865028 21633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:27.860417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:34405)
0929 22:46:27.860571 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:27.860590 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:27.860649 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:27.860788 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:27.860789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:27.860953 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:27.861002 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:27.861003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.861635 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.861636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:27.862183 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:27.862185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.862558 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.862560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:27.862608 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:27.863073 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:27.863078 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:27.864969 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
W20260929 22:46:27.865188 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:27.860491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:34405 (local address 127.12.27.190:39705)
0929 22:46:27.860575 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:27.860577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:27.860649 (+ 72us) server_negotiation.cc:407] Connection header received
0929 22:46:27.860694 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:27.860695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:27.860708 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:27.860764 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:27.861075 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.861568 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.862265 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:27.862463 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:27.862520 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:27.865101 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:34405: BlockingRecv error: recv got EOF from 127.12.27.131:34405 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 29 22:46:28 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:28 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:28.603089 21634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:28.598125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:56189)
0929 22:46:28.598290 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:28.598326 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:28.598394 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:28.598580 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:28.598582 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:28.598763 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:28.598819 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:28.598821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.599529 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.599530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:28.600159 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:28.600162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.600681 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.600682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:28.600727 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:28.601192 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:28.601196 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:28.603029 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
W20260929 22:46:28.603282 21635 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:28.598210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:56189 (local address 127.12.27.190:39705)
0929 22:46:28.598378 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:28.598380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:28.598391 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:46:28.598445 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:28.598446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:28.598457 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:28.598564 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:28.598897 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.599451 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.600296 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.600613 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.600672 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:28.603181 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:56189: BlockingRecv error: recv got EOF from 127.12.27.129:56189 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
Sep 29 22:46:28 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:28 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:28.731138 21636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:28.726250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:38597)
0929 22:46:28.726412 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:28.726423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:28.726492 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:28.726631 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:28.726632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:28.726800 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:28.726848 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:28.726850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.727522 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.727523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:28.728120 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:28.728122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.728477 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.728478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:28.728521 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:28.729096 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:28.729102 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:28.731078 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
W20260929 22:46:28.731303 21635 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:28.726361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:38597 (local address 127.12.27.190:39705)
0929 22:46:28.726441 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:28.726442 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:28.726491 (+ 49us) server_negotiation.cc:407] Connection header received
0929 22:46:28.726556 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:28.726557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:28.726567 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:28.726612 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:28.726921 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.727424 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.728211 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.728407 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.728464 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:28.731203 (+ 2739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:38597: BlockingRecv error: recv got EOF from 127.12.27.130:38597 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 29 22:46:28 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:28 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:28.870146 21637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:28.865575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:56041)
0929 22:46:28.865733 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:28.865746 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:28.865843 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:28.865999 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:28.865999 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:28.866165 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:28.866214 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:28.866215 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.866884 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.866885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:28.867406 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:28.867407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.867779 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.867780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:28.867849 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:28.868293 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:28.868298 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:28.870079 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
W20260929 22:46:28.870268 21635 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:28.865673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:56041 (local address 127.12.27.190:39705)
0929 22:46:28.865780 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:28.865782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:28.865829 (+ 47us) server_negotiation.cc:407] Connection header received
0929 22:46:28.865893 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:28.865894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:28.865905 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:28.865963 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:28.866296 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.866810 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.867501 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:28.867711 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:28.867781 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:28.870180 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:56041: BlockingRecv error: recv got EOF from 127.12.27.131:56041 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Sep 29 22:46:29 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:29 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:29.608505 21638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:29.603582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:56783)
0929 22:46:29.603746 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:29.603759 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:29.603824 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:29.603967 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:29.603968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:29.604137 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:29.604184 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:29.604186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.604891 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.604892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:29.605456 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:29.605458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.605847 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.605848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:29.605891 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:29.606414 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:29.606425 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:29.608437 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
W20260929 22:46:29.608633 21639 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:29.603688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:56783 (local address 127.12.27.190:39705)
0929 22:46:29.603831 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:29.603833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:29.603842 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:46:29.603881 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:29.603881 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:29.603891 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:29.603948 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:29.604262 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.604812 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.605541 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.605774 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.605832 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:29.608548 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:56783: BlockingRecv error: recv got EOF from 127.12.27.129:56783 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
Sep 29 22:46:29 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:29 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:29.736562 21640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:29.731674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:38969)
0929 22:46:29.731850 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:29.731863 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:29.731930 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:29.732079 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:29.732080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:29.732234 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:29.732289 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:29.732291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.732982 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.732983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:29.733680 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:29.733683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.734097 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.734098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:29.734153 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:29.734589 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:29.734594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:29.736466 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":124,"threads_started":1}
W20260929 22:46:29.736611 21639 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:29.731848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:38969 (local address 127.12.27.190:39705)
0929 22:46:29.731941 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:29.731943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:29.731955 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:46:29.731992 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:29.731993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:29.732003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:29.732057 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:29.732364 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.732908 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.733772 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.734025 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.734100 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:29.736547 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:38969: BlockingRecv error: recv got EOF from 127.12.27.130:38969 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 29 22:46:29 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:29 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:29.876072 21641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:29.870712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:56093)
0929 22:46:29.870944 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:29.870958 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:29.871034 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:29.871237 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:29.871238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:29.871457 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:29.871511 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:29.871513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.872304 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.872306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:29.872954 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:29.872956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.873379 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.873380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:29.873445 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:29.873884 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:29.873889 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:29.875964 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":123,"threads_started":1}
W20260929 22:46:29.876127 21639 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:29.870920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:56093 (local address 127.12.27.190:39705)
0929 22:46:29.870996 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:29.870998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:29.871011 (+ 13us) server_negotiation.cc:407] Connection header received
0929 22:46:29.871110 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:29.871111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:29.871124 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:29.871230 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:29.871602 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.872186 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.873058 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:29.873278 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:29.873377 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:29.876054 (+ 2677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:56093: BlockingRecv error: recv got EOF from 127.12.27.131:56093 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 29 22:46:30 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:30 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:30.614049 21642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:30.609084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:60857)
0929 22:46:30.609252 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:30.609264 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:30.609321 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:30.609502 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:30.609503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:30.609706 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:30.609755 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:30.609757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.610543 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.610545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:30.611091 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:30.611093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.611488 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.611489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:30.611554 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:30.612071 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:30.612075 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:30.613980 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
W20260929 22:46:30.614167 21643 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:30.609182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:60857 (local address 127.12.27.190:39705)
0929 22:46:30.609344 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:30.609346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:30.609354 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:30.609377 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:30.609378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:30.609388 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:30.609449 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:30.609849 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.610459 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.611185 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.611398 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.611486 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:30.614086 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:60857: BlockingRecv error: recv got EOF from 127.12.27.129:60857 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
Sep 29 22:46:30 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:30 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:30.741917 21644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:30.737099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:35045)
0929 22:46:30.737288 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:30.737300 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:30.737364 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:30.737498 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:30.737499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:30.737671 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:30.737718 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:30.737720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.738367 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.738368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:30.738892 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:30.738894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.739224 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.739225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:30.739268 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:30.739836 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:30.739840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:30.741815 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":100,"threads_started":1}
W20260929 22:46:30.741948 21643 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:30.737185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:35045 (local address 127.12.27.190:39705)
0929 22:46:30.737272 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:30.737274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:30.737361 (+ 87us) server_negotiation.cc:407] Connection header received
0929 22:46:30.737419 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:30.737419 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:30.737429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:30.737483 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:30.737788 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.738299 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.738969 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.739156 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.739209 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:30.741901 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:35045: BlockingRecv error: recv got EOF from 127.12.27.130:35045 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Sep 29 22:46:30 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:30 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:30.881431 21645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:30.876488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:50895)
0929 22:46:30.876691 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:30.876703 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:30.876773 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:30.876931 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:30.876932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:30.877122 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:30.877167 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:30.877169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.877876 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.877877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:30.878431 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:30.878433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.878816 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.878817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:30.878877 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:30.879319 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:30.879324 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:30.881325 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":114,"threads_started":1}
W20260929 22:46:30.881467 21643 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:30.876579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:50895 (local address 127.12.27.190:39705)
0929 22:46:30.876675 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:30.876677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:30.876791 (+ 114us) server_negotiation.cc:407] Connection header received
0929 22:46:30.876837 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:30.876838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:30.876852 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:30.876925 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:30.877291 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.877787 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.878522 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:30.878712 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:30.878815 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:30.881402 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:50895: BlockingRecv error: recv got EOF from 127.12.27.131:50895 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Sep 29 22:46:31 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:31 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:31.619899 21646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:31.614591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:45171)
0929 22:46:31.614839 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:31.614852 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:31.614979 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:31.615138 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:31.615139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:31.615312 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:31.615358 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:31.615359 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.616193 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.616194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:31.617025 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:31.617027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.617416 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.617416 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:31.617464 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:31.617937 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:31.617941 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:31.619797 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":184,"threads_started":1}
W20260929 22:46:31.620012 21647 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:31.614717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:45171 (local address 127.12.27.190:39705)
0929 22:46:31.614866 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:31.614873 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:31.614997 (+ 124us) server_negotiation.cc:407] Connection header received
0929 22:46:31.615033 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:31.615034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:31.615046 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:31.615125 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:31.615442 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.616085 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.617116 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.617314 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.617377 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:31.619912 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:45171: BlockingRecv error: recv got EOF from 127.12.27.129:45171 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
Sep 29 22:46:31 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:31 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:31.747284 21648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:31.742446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:48835)
0929 22:46:31.742593 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:31.742607 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:31.742691 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:31.742886 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:31.742887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:31.743080 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:31.743125 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:31.743127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.743896 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.743897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:31.744428 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:31.744430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.744822 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.744823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:31.744887 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:31.745367 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:31.745371 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:31.747207 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
W20260929 22:46:31.747408 21647 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:31.742622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:48835 (local address 127.12.27.190:39705)
0929 22:46:31.742692 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:31.742695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:31.742705 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:31.742794 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:31.742794 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:31.742805 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:31.742877 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:31.743217 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.743808 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.744533 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.744737 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.744811 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:31.747307 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:48835: BlockingRecv error: recv got EOF from 127.12.27.130:48835 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 22:46:31 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:31 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:31.887377 21649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:31.882085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:54213)
0929 22:46:31.882302 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:31.882317 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:31.882396 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:31.882571 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:31.882573 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:31.882790 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:31.882838 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:31.882840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.883671 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.883672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:31.884271 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:31.884273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.884727 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.884728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:31.884799 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:31.885251 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:31.885257 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:31.887302 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":125,"threads_started":1}
W20260929 22:46:31.887444 21647 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:31.882245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:54213 (local address 127.12.27.190:39705)
0929 22:46:31.882307 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:31.882309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:31.882409 (+ 100us) server_negotiation.cc:407] Connection header received
0929 22:46:31.882463 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:31.882464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:31.882482 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:31.882565 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:31.882941 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.883538 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.884375 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:31.884600 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:31.884713 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:31.887397 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:54213: BlockingRecv error: recv got EOF from 127.12.27.131:54213 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Sep 29 22:46:32 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:32 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:32.628640 21650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:32.620379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:39567)
0929 22:46:32.620542 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:32.620555 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:32.620639 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:32.620861 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:32.620863 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:32.621043 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:32.621090 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:32.621091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.621977 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.621978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:32.622522 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:32.622524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.622918 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.622919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:32.622962 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:32.626670 (+ 3708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:32.626676 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:32.628572 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
W20260929 22:46:32.628837 21651 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:32.620498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:39567 (local address 127.12.27.190:39705)
0929 22:46:32.620647 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:32.620649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:32.620660 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:46:32.620734 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:32.620735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:32.620747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:32.620831 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:32.621169 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.621881 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.622609 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.622842 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.622896 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:32.628752 (+ 5856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:39567: BlockingRecv error: recv got EOF from 127.12.27.129:39567 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
Sep 29 22:46:32 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:32 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:32.752656 21652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:32.747807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:39131)
0929 22:46:32.747940 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:32.747959 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:32.748019 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:32.748153 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:32.748154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:32.748351 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:32.748398 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:32.748400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.749112 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.749113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:32.749678 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:32.749680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.750047 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.750048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:32.750094 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:32.750548 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:32.750552 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:32.752586 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
W20260929 22:46:32.752769 21651 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:32.747917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:39131 (local address 127.12.27.190:39705)
0929 22:46:32.747960 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:32.747962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:32.748002 (+ 40us) server_negotiation.cc:407] Connection header received
0929 22:46:32.748075 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:32.748075 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:32.748085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:32.748133 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:32.748471 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.749019 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.749795 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.749980 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.750028 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:32.752720 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:39131: BlockingRecv error: recv got EOF from 127.12.27.130:39131 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 22:46:32 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:32 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 22:46:32.892968 21651 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:32.887959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:33719 (local address 127.12.27.190:39705)
0929 22:46:32.888031 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:32.888034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:32.888116 (+ 82us) server_negotiation.cc:407] Connection header received
0929 22:46:32.888186 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:32.888187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:32.888201 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:32.888274 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:32.888653 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.889202 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.890134 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.890349 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.890409 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:32.892902 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:33719: BlockingRecv error: recv got EOF from 127.12.27.131:33719 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:46:32.892825 21653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:32.887905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:33719)
0929 22:46:32.888056 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:32.888067 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:32.888131 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:32.888280 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:32.888281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:32.888497 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:32.888543 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:32.888545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.889296 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.889297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:32.890038 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:32.890041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:32.890416 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:32.890416 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:32.890456 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:32.890998 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:32.891004 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:32.892761 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
Sep 29 22:46:33 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:33 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:33.634655 21654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:33.629133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:58715)
0929 22:46:33.629346 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:33.629356 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:33.629416 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:33.629554 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:33.629555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:33.629723 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:33.629772 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:33.629773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.630681 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.630682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:33.631443 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:33.631447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.631893 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.631894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:33.631939 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:33.632622 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:33.632627 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:33.634593 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":154,"threads_started":1}
W20260929 22:46:33.634836 21655 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:33.629223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:58715 (local address 127.12.27.190:39705)
0929 22:46:33.629375 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:33.629376 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:33.629401 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:46:33.629473 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:33.629473 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:33.629483 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:33.629554 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:33.629918 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.630574 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.631548 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.631834 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.631892 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:33.634701 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:58715: BlockingRecv error: recv got EOF from 127.12.27.129:58715 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":61,"threads_started":1}
Sep 29 22:46:33 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:33 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:33.757943 21656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:33.753234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:38263)
0929 22:46:33.753384 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:33.753397 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:33.753454 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:33.753645 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:33.753646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:33.753816 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:33.753864 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:33.753866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.754516 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.754517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:33.755039 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:33.755041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.755402 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.755403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:33.755444 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:33.755992 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:33.755997 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:33.757882 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
W20260929 22:46:33.758105 21655 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:33.753345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:38263 (local address 127.12.27.190:39705)
0929 22:46:33.753416 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:33.753418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:33.753445 (+ 27us) server_negotiation.cc:407] Connection header received
0929 22:46:33.753552 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:33.753553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:33.753565 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:33.753628 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:33.753935 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.754448 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.755125 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.755333 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.755390 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:33.758008 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:38263: BlockingRecv error: recv got EOF from 127.12.27.130:38263 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 29 22:46:33 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:33 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.131@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:33.898535 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:33.893557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.131:56627)
0929 22:46:33.893771 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:33.893783 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:33.893862 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:33.894039 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:33.894039 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:33.894245 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:33.894290 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:33.894292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.895111 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.895112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:33.895723 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:33.895726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.896083 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.896084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:33.896124 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:33.896556 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:33.896562 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:33.898475 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":111,"threads_started":1}
W20260929 22:46:33.898664 21655 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:33.893660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:56627 (local address 127.12.27.190:39705)
0929 22:46:33.893754 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:33.893756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:33.893856 (+ 100us) server_negotiation.cc:407] Connection header received
0929 22:46:33.893933 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:33.893934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:33.893955 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:33.894018 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:33.894407 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.895037 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.895837 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:33.896017 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:33.896071 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:33.898582 (+ 2511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.131:56627: BlockingRecv error: recv got EOF from 127.12.27.131:56627 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Sep 29 22:46:34 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:34 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.129@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:34.639853 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:34.635211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.129:42689)
0929 22:46:34.635347 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:34.635364 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:34.635412 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:34.635589 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:34.635590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:34.635799 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:34.635849 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:34.635851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.636578 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.636579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:34.637166 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:34.637168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.637574 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.637575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:34.637617 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:34.638056 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:34.638060 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:34.639785 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
W20260929 22:46:34.639969 21659 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:34.635330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:42689 (local address 127.12.27.190:39705)
0929 22:46:34.635461 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:34.635463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:34.635472 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:46:34.635502 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:34.635502 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:34.635512 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:34.635574 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:34.635921 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.636500 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.637287 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.637495 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.637550 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:34.639881 (+ 2331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.129:42689: BlockingRecv error: recv got EOF from 127.12.27.129:42689 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
Sep 29 22:46:34 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 22:46:34 dist-test-slave-00d6 krb5kdc[20601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.27.130@KRBTEST.COM for oryx/127.12.27.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 22:46:34.763592 21660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:34.758607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39705 (local address 127.12.27.130:56281)
0929 22:46:34.758823 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:34.758835 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:34.758899 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:34.759034 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:34.759034 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:34.759197 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:34.759250 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:34.759252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.759999 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.760001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:34.760755 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:34.760757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.761106 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.761107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:34.761156 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:34.761615 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:34.761619 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:34.763504 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.27.190:39705: Server oryx/127.12.27.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":163,"threads_started":1}
W20260929 22:46:34.763768 21659 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:34.758662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:56281 (local address 127.12.27.190:39705)
0929 22:46:34.758760 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:34.758763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:34.758905 (+ 142us) server_negotiation.cc:407] Connection header received
0929 22:46:34.758952 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:34.758953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:34.758964 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:34.759019 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:34.759319 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.759908 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.760840 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.761037 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.761093 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:34.763601 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.27.130:56281: BlockingRecv error: recv got EOF from 127.12.27.130:56281 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260929 22:46:34.814224 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21184
I20260929 22:46:34.818725 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21336
I20260929 22:46:34.823021 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21468
I20260929 22:46:34.826789 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21114
2026-09-29T22:46:34Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17525 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-29T22:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:34Z Disabled control of system clock
I20260929 22:46:34.854233 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45391
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:41717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:45391
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 22:46:34.934492 21664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:34.934695 21664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:34.934716 21664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:34.935829 21664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:34.935866 21664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:34.935878 21664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:34.935894 21664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:34.935906 21664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:34.937139 21664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:45391
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:34.937330 21664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:34.937547 21664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:46:34.942785 21664 server_base.cc:1034] running on GCE node
W20260929 22:46:34.942904 21672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:34.942888 21669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:34.942916 21670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:34.943389 21664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:34.943758 21664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:34.944947 21664 hybrid_clock.cc:648] HybridClock initialized: now 1790721994944936 us; error 38 us; skew 500 ppm
I20260929 22:46:34.946308 21664 webserver.cc:460] Webserver started at http://127.12.27.190:42207/ using document root <none> and password file <none>
I20260929 22:46:34.946550 21664 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:34.946621 21664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:34.946790 21664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:34.947981 21664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "aee8ef282b82455391cc17d41bf34183"
format_stamp: "Formatted at 2026-09-29 22:46:34 on dist-test-slave-00d6"
server_key: "53e7d1a0f2a634cd6409ade14a1f0bba"
server_key_iv: "cb172b07456ca94f2e18354ce8099566"
server_key_version: "encryptionkey@0"
I20260929 22:46:34.948390 21664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "aee8ef282b82455391cc17d41bf34183"
format_stamp: "Formatted at 2026-09-29 22:46:34 on dist-test-slave-00d6"
server_key: "53e7d1a0f2a634cd6409ade14a1f0bba"
server_key_iv: "cb172b07456ca94f2e18354ce8099566"
server_key_version: "encryptionkey@0"
I20260929 22:46:34.949697 21664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:46:34.950433 21678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:34.950620 21664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:46:34.950721 21664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "aee8ef282b82455391cc17d41bf34183"
format_stamp: "Formatted at 2026-09-29 22:46:34 on dist-test-slave-00d6"
server_key: "53e7d1a0f2a634cd6409ade14a1f0bba"
server_key_iv: "cb172b07456ca94f2e18354ce8099566"
server_key_version: "encryptionkey@0"
I20260929 22:46:34.950804 21664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:34.965459 21664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:34.965791 21664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:34.965946 21664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:34.970252 21664 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:45391
I20260929 22:46:34.970304 21730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:45391 every 8 connection(s)
I20260929 22:46:34.970714 21664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:46:34.971414 21731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:34.974007 21731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183: Bootstrap starting.
I20260929 22:46:34.974612 21731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:34.974912 21731 log.cc:824] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:34.975590 21731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183: No bootstrap required, opened a new log
I20260929 22:46:34.977258 21731 raft_consensus.cc:348] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aee8ef282b82455391cc17d41bf34183" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45391 } }
I20260929 22:46:34.977423 21731 raft_consensus.cc:374] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:34.977469 21731 raft_consensus.cc:729] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee8ef282b82455391cc17d41bf34183, State: Initialized, Role: FOLLOWER
I20260929 22:46:34.977633 21731 consensus_queue.cc:260] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aee8ef282b82455391cc17d41bf34183" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45391 } }
I20260929 22:46:34.977717 21731 raft_consensus.cc:388] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:46:34.977761 21731 raft_consensus.cc:482] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:46:34.977811 21731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:34.978394 21731 raft_consensus.cc:504] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aee8ef282b82455391cc17d41bf34183" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45391 } }
I20260929 22:46:34.978507 21731 leader_election.cc:302] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aee8ef282b82455391cc17d41bf34183; no voters:
I20260929 22:46:34.978641 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21664
I20260929 22:46:34.978696 21731 leader_election.cc:288] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:46:34.978762 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:46:34.978737 21734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:34.978879 21734 raft_consensus.cc:686] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [term 1 LEADER]: Becoming Leader. State: Replica: aee8ef282b82455391cc17d41bf34183, State: Running, Role: LEADER
I20260929 22:46:34.978960 21731 sys_catalog.cc:564] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:46:34.978983 12398 external_mini_cluster.cc:1428] Setting key 79cdfb8ad88c1ee74e2387cb60352190
I20260929 22:46:34.978971 21734 consensus_queue.cc:237] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aee8ef282b82455391cc17d41bf34183" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45391 } }
I20260929 22:46:34.979292 21734 sys_catalog.cc:455] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aee8ef282b82455391cc17d41bf34183. Latest consensus state: current_term: 1 leader_uuid: "aee8ef282b82455391cc17d41bf34183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aee8ef282b82455391cc17d41bf34183" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45391 } } }
I20260929 22:46:34.979777 21734 sys_catalog.cc:458] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:34.979816 21735 sys_catalog.cc:455] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aee8ef282b82455391cc17d41bf34183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aee8ef282b82455391cc17d41bf34183" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45391 } } }
I20260929 22:46:34.979902 21735 sys_catalog.cc:458] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183 [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:34.980036 21745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:46:34.980536 21745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:46:34.982445 21745 catalog_manager.cc:1347] Generated new cluster ID: 9e29ac7906f14d9a9d81ee11dc5f8231
I20260929 22:46:34.982496 21745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:46:34.985827 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:34.979591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45038 (local address 127.12.27.190:45391)
0929 22:46:34.980340 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:34.980349 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:34.980380 (+ 31us) server_negotiation.cc:407] Connection header received
0929 22:46:34.980497 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:34.980504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:34.980581 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:34.981076 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:34.981179 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.982550 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.983664 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:34.984266 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:34.984378 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:34.985146 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:34.985150 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:34.985150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:34.985355 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:34.985393 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:34.985405 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:34.985464 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:34.985559 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 22:46:34.985629 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":124,"threads_started":1}
I20260929 22:46:35.015055 21745 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:46:35.015846 21745 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:46:35.032830 21745 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aee8ef282b82455391cc17d41bf34183: Generated new TSK 0
I20260929 22:46:35.033066 21745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:46:35.039839 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45391
--builtin_ntp_servers=127.12.27.148:41717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 22:46:35.122323 21755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.122531 21755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.122552 21755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.123808 21755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.123852 21755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.123876 21755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:46:35.125322 21755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.125589 21755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.125908 21755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:35.130888 21760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.130882 21761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.130882 21763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.131103 21755 server_base.cc:1034] running on GCE node
I20260929 22:46:35.131358 21755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.131610 21755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.132802 21755 hybrid_clock.cc:648] HybridClock initialized: now 1790721995132781 us; error 40 us; skew 500 ppm
I20260929 22:46:35.134047 21755 webserver.cc:460] Webserver started at http://127.12.27.129:39697/ using document root <none> and password file <none>
I20260929 22:46:35.134298 21755 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.134346 21755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.134491 21755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.135540 21755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "30bb535ef47947c38aec071120870e67"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "978fab23000b85b38794fa28e64f00a5"
server_key_iv: "1e8f720cb18b8aa62a9cce8685f8295c"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.135964 21755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "30bb535ef47947c38aec071120870e67"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "978fab23000b85b38794fa28e64f00a5"
server_key_iv: "1e8f720cb18b8aa62a9cce8685f8295c"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.137233 21755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:35.137933 21769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.138103 21755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.138197 21755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "30bb535ef47947c38aec071120870e67"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "978fab23000b85b38794fa28e64f00a5"
server_key_iv: "1e8f720cb18b8aa62a9cce8685f8295c"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.138276 21755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.158468 21755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.158785 21755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.158960 21755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.159191 21755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:35.159516 21755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:35.159571 21755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.159613 21755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:35.159668 21755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.165388 21755 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:43789
I20260929 22:46:35.165477 21882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:43789 every 8 connection(s)
I20260929 22:46:35.165794 21755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:46:35.170753 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.166608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:37117 (local address 127.12.27.190:45391)
0929 22:46:35.166693 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.166695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.166826 (+ 131us) server_negotiation.cc:407] Connection header received
0929 22:46:35.167291 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.167292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.167304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.167374 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.168039 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.168537 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.169474 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.169648 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.169697 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:35.170552 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.170553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.170553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.170558 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.170568 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.170571 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.170605 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.170672 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.170694 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260929 22:46:35.170939 21885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.166511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45391 (local address 127.12.27.129:37117)
0929 22:46:35.166698 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:35.166732 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:35.167206 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:35.167429 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:35.167433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:35.167441 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:35.167958 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:35.167962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.168621 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.168622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:35.169403 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:35.169404 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.169720 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.169720 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:35.169828 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:35.170433 (+ 605us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:46:35.170433 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:35.170461 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:46:35.170482 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:35.170612 (+ 130us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:35.170615 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:35.170617 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:46:35.170662 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:46:35.170736 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260929 22:46:35.171478 21883 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45391
I20260929 22:46:35.171578 21883 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:35.171775 21883 heartbeater.cc:511] Master 127.12.27.190:45391 requested a full tablet report, sending...
I20260929 22:46:35.172304 21695 ts_manager.cc:194] Registered new tserver with Master: 30bb535ef47947c38aec071120870e67 (127.12.27.129:43789)
I20260929 22:46:35.172926 21695 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.129:37117
I20260929 22:46:35.175103 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21755
I20260929 22:46:35.175217 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:46:35.175412 12398 external_mini_cluster.cc:1428] Setting key bda581092a21af99adbed002cc652a8f
I20260929 22:46:35.176278 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45391
--builtin_ntp_servers=127.12.27.148:41717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 22:46:35.256177 21886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.256395 21886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.256417 21886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.257603 21886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.257648 21886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.257674 21886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:46:35.258993 21886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.259248 21886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.259550 21886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:35.264520 21892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.264520 21894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.264534 21891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.264814 21886 server_base.cc:1034] running on GCE node
I20260929 22:46:35.264998 21886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.265185 21886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.266326 21886 hybrid_clock.cc:648] HybridClock initialized: now 1790721995266304 us; error 35 us; skew 500 ppm
I20260929 22:46:35.267730 21886 webserver.cc:460] Webserver started at http://127.12.27.130:33331/ using document root <none> and password file <none>
I20260929 22:46:35.267943 21886 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.267985 21886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.268074 21886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.269165 21886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "47ed61c48c274d3483432b232529990f"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "69a05867c4dc0d6dad893cd2c88898f4"
server_key_iv: "c9bb9d975ab7a70c6d5405891cf3fdd8"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.269533 21886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "47ed61c48c274d3483432b232529990f"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "69a05867c4dc0d6dad893cd2c88898f4"
server_key_iv: "c9bb9d975ab7a70c6d5405891cf3fdd8"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.270817 21886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:46:35.271440 21900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.271595 21886 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:35.271725 21886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "47ed61c48c274d3483432b232529990f"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "69a05867c4dc0d6dad893cd2c88898f4"
server_key_iv: "c9bb9d975ab7a70c6d5405891cf3fdd8"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.271785 21886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.281850 21886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.282088 21886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.282191 21886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.282351 21886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:35.282601 21886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:35.282630 21886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.282650 21886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:35.282670 21886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.288121 21886 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:33457
I20260929 22:46:35.288172 22013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:33457 every 8 connection(s)
I20260929 22:46:35.288491 21886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:46:35.290664 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 21886
I20260929 22:46:35.290737 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:46:35.290940 12398 external_mini_cluster.cc:1428] Setting key 438a724deef6274787a316f8e2a2b2de
I20260929 22:46:35.291934 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45391
--builtin_ntp_servers=127.12.27.148:41717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260929 22:46:35.294097 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.289254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:57615 (local address 127.12.27.190:45391)
0929 22:46:35.289345 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.289347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.289549 (+ 202us) server_negotiation.cc:407] Connection header received
0929 22:46:35.290080 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.290081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.290093 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.290153 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.290869 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.291507 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.292606 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.292828 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.292910 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:35.293772 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.293773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.293773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.293778 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.293798 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.293803 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.293862 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.293993 (+ 131us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.294020 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:46:35.294304 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.289238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45391 (local address 127.12.27.130:57615)
0929 22:46:35.289433 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:35.289465 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:35.289972 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:35.290230 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:35.290233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:35.290241 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:35.290762 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:35.290769 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.291596 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.291598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:35.292516 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:35.292518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.292917 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.292918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:35.293051 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:35.293518 (+ 467us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:46:35.293519 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:35.293558 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:46:35.293585 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:35.293888 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:35.293895 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:35.293899 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:35.293984 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:46:35.294086 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260929 22:46:35.294793 22014 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45391
I20260929 22:46:35.294878 22014 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:35.295061 22014 heartbeater.cc:511] Master 127.12.27.190:45391 requested a full tablet report, sending...
I20260929 22:46:35.295449 21695 ts_manager.cc:194] Registered new tserver with Master: 47ed61c48c274d3483432b232529990f (127.12.27.130:33457)
I20260929 22:46:35.295864 21695 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.130:57615
W20260929 22:46:35.374749 22017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.374955 22017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.374975 22017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.376151 22017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.376191 22017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.376219 22017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:46:35.377549 22017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.377743 22017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.377982 22017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:35.383332 22023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.383312 22025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.383358 22017 server_base.cc:1034] running on GCE node
W20260929 22:46:35.383322 22022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.383886 22017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.384089 22017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.385234 22017 hybrid_clock.cc:648] HybridClock initialized: now 1790721995385220 us; error 28 us; skew 500 ppm
I20260929 22:46:35.386519 22017 webserver.cc:460] Webserver started at http://127.12.27.131:35201/ using document root <none> and password file <none>
I20260929 22:46:35.386790 22017 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.386839 22017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.387004 22017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.388149 22017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "c7b478557a304038b299eea7a4652ac6"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "cf7e808434ad9d481857cae2a0d1eddc"
server_key_iv: "6d15b5c02a9c928024ec6d98168a519d"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.388540 22017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "c7b478557a304038b299eea7a4652ac6"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "cf7e808434ad9d481857cae2a0d1eddc"
server_key_iv: "6d15b5c02a9c928024ec6d98168a519d"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.389823 22017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:46:35.390599 22031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.390779 22017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:35.390877 22017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "c7b478557a304038b299eea7a4652ac6"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "cf7e808434ad9d481857cae2a0d1eddc"
server_key_iv: "6d15b5c02a9c928024ec6d98168a519d"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.390959 22017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.440163 22017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.440515 22017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.440691 22017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.440943 22017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:35.441366 22017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:35.441423 22017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.441459 22017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:35.441485 22017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.447357 22017 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:46867
I20260929 22:46:35.447400 22144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:46867 every 8 connection(s)
I20260929 22:46:35.447748 22017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:46:35.448185 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22017
I20260929 22:46:35.448271 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:46:35.448556 12398 external_mini_cluster.cc:1428] Setting key e554aaae1e87b762327de0c88afbc7f6
I20260929 22:46:35.453403 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.448479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:48423 (local address 127.12.27.190:45391)
0929 22:46:35.448569 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.448572 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.448902 (+ 330us) server_negotiation.cc:407] Connection header received
0929 22:46:35.449606 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.449607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.449619 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.449662 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.450346 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.450892 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.451989 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.452200 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.452291 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:35.453107 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.453108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.453108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.453113 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.453128 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.453134 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.453198 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.453293 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.453321 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260929 22:46:35.453639 22147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.448473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45391 (local address 127.12.27.131:48423)
0929 22:46:35.448728 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:35.448781 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:35.449522 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:35.449729 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:35.449733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:35.449743 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:35.450241 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:35.450245 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.450995 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.450996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:35.451894 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:35.451896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:35.452298 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:35.452299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:35.452435 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:35.452957 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:46:35.452957 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:35.452985 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:46:35.453008 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:35.453200 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:35.453206 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:35.453209 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:46:35.453295 (+ 86us) client_negotiation.cc:240] Negotiation successful
0929 22:46:35.453394 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":119,"threads_started":1}
I20260929 22:46:35.454115 22145 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45391
I20260929 22:46:35.454192 22145 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:35.454373 22145 heartbeater.cc:511] Master 127.12.27.190:45391 requested a full tablet report, sending...
I20260929 22:46:35.454783 21695 ts_manager.cc:194] Registered new tserver with Master: c7b478557a304038b299eea7a4652ac6 (127.12.27.131:46867)
I20260929 22:46:35.455159 21695 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.131:48423
I20260929 22:46:35.460677 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 22:46:35.462594 21744 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:35.462119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.12.27.190:45391)
0929 22:46:35.462183 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.462187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.462293 (+ 106us) server_negotiation.cc:407] Connection header received
0929 22:46:35.462347 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.462347 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.462358 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.462407 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.462517 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45042: BlockingRecv error: recv got EOF from 127.0.0.1:45042 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:46:35.462680 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21755
I20260929 22:46:35.467613 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21886
I20260929 22:46:35.472393 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22017
I20260929 22:46:35.476462 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 21664
2026-09-29T22:46:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (648 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-29T22:46:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:35Z Disabled control of system clock
I20260929 22:46:35.503044 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45251
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:45251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:46:35.584867 22156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.585090 22156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.585126 22156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.586427 22156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:35.586476 22156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.586489 22156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.586503 22156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:35.586514 22156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:35.588023 22156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:45251
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.588281 22156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.588598 22156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:35.593889 22161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.594050 22156 server_base.cc:1034] running on GCE node
W20260929 22:46:35.593856 22164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.593856 22162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.594487 22156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.594787 22156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.595943 22156 hybrid_clock.cc:648] HybridClock initialized: now 1790721995595926 us; error 37 us; skew 500 ppm
I20260929 22:46:35.597294 22156 webserver.cc:460] Webserver started at http://127.12.27.190:45077/ using document root <none> and password file <none>
I20260929 22:46:35.597546 22156 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.597616 22156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.597771 22156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.598914 22156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "9db7e5840056462b5ba481c017fe8cc8"
server_key_iv: "1b5e19b2d3b3f60da0757589b7b48d3f"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.599295 22156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "9db7e5840056462b5ba481c017fe8cc8"
server_key_iv: "1b5e19b2d3b3f60da0757589b7b48d3f"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.600744 22156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:35.601563 22170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.601781 22156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:35.601888 22156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "9db7e5840056462b5ba481c017fe8cc8"
server_key_iv: "1b5e19b2d3b3f60da0757589b7b48d3f"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.601970 22156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.605593 22156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.605852 22156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.606000 22156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.609959 22156 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:45251
I20260929 22:46:35.609989 22222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:45251 every 8 connection(s)
I20260929 22:46:35.610311 22156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:46:35.610981 22223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:35.613689 22223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3: Bootstrap starting.
I20260929 22:46:35.614212 22223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:35.614444 22223 log.cc:824] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:35.615074 22223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3: No bootstrap required, opened a new log
I20260929 22:46:35.616683 22223 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45251 } }
I20260929 22:46:35.616827 22223 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:35.616851 22223 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3afd9b3e6a0426d8e13ab778b2c4be3, State: Initialized, Role: FOLLOWER
I20260929 22:46:35.616986 22223 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45251 } }
I20260929 22:46:35.617066 22223 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:46:35.617089 22223 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:46:35.617121 22223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:35.617365 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22156
I20260929 22:46:35.617453 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:46:35.617637 12398 external_mini_cluster.cc:1428] Setting key b79dcfae2a7c6c01718eabea3dd4a6e2
I20260929 22:46:35.617935 22223 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45251 } }
I20260929 22:46:35.618054 22223 leader_election.cc:302] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3afd9b3e6a0426d8e13ab778b2c4be3; no voters:
I20260929 22:46:35.618217 22223 leader_election.cc:288] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:46:35.618275 22227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:35.618454 22227 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [term 1 LEADER]: Becoming Leader. State: Replica: c3afd9b3e6a0426d8e13ab778b2c4be3, State: Running, Role: LEADER
I20260929 22:46:35.618579 22223 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:46:35.618584 22227 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45251 } }
I20260929 22:46:35.619261 22230 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3afd9b3e6a0426d8e13ab778b2c4be3. Latest consensus state: current_term: 1 leader_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45251 } } }
I20260929 22:46:35.619415 22230 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:35.619673 22229 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3afd9b3e6a0426d8e13ab778b2c4be3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45251 } } }
I20260929 22:46:35.619740 22229 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:35.619879 22236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:46:35.620396 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.618169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41140 (local address 127.12.27.190:45251)
0929 22:46:35.618491 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.618500 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.618530 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:46:35.618645 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.618652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.618698 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.619126 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.619740 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.619744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.619744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.619749 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.619802 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.619816 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.619885 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.620101 (+ 216us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.620167 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":104,"threads_started":1}
I20260929 22:46:35.620417 22236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:46:35.622299 22236 catalog_manager.cc:1347] Generated new cluster ID: 0e85b45f76cf4bb293d08b57a45a23a7
I20260929 22:46:35.622375 22236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:46:35.628894 22236 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:46:35.629058 22236 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:46:35.650234 22236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3afd9b3e6a0426d8e13ab778b2c4be3: Generated new TSK 0
I20260929 22:46:35.650490 22236 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:46:35.653364 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45251
--builtin_ntp_servers=127.12.27.148:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:46:35.736871 22247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.737113 22247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.737152 22247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.738381 22247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.738444 22247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.738487 22247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:46:35.739905 22247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.740170 22247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.740470 22247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:35.746600 22252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.746626 22253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.746814 22247 server_base.cc:1034] running on GCE node
W20260929 22:46:35.746754 22255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.747145 22247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.747409 22247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.748571 22247 hybrid_clock.cc:648] HybridClock initialized: now 1790721995748558 us; error 26 us; skew 500 ppm
I20260929 22:46:35.750087 22247 webserver.cc:460] Webserver started at http://127.12.27.129:43913/ using document root <none> and password file <none>
I20260929 22:46:35.750371 22247 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.750440 22247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.750581 22247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.751942 22247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "5d2e1716003940f285a27f6cabd35394"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "f883085d823a2df2b8c79ab683794960"
server_key_iv: "f8fdd8999e747c1d6138ff98cdd078fa"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.752331 22247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "5d2e1716003940f285a27f6cabd35394"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "f883085d823a2df2b8c79ab683794960"
server_key_iv: "f8fdd8999e747c1d6138ff98cdd078fa"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.753911 22247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:46:35.754635 22261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.754810 22247 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:46:35.754904 22247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "5d2e1716003940f285a27f6cabd35394"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "f883085d823a2df2b8c79ab683794960"
server_key_iv: "f8fdd8999e747c1d6138ff98cdd078fa"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.754957 22247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.758226 22247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.758460 22247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.758553 22247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.758699 22247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:35.758997 22247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:35.759037 22247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.759056 22247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:35.759104 22247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.764508 22247 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:40497
I20260929 22:46:35.764591 22374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:40497 every 8 connection(s)
I20260929 22:46:35.764902 22247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:46:35.767844 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.765605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:53285 (local address 127.12.27.190:45251)
0929 22:46:35.765662 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.765664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.765891 (+ 227us) server_negotiation.cc:407] Connection header received
0929 22:46:35.766336 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.766337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.766344 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.766395 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.767569 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.767570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.767570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.767574 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.767588 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.767592 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.767666 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.767755 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.767770 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:46:35.768035 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.765590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45251 (local address 127.12.27.129:53285)
0929 22:46:35.765772 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:35.765803 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:35.766254 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:35.766459 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:35.766462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:35.766470 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:35.767425 (+ 955us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:46:35.767425 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:35.767453 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:46:35.767480 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:35.767677 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:35.767682 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:35.767689 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 22:46:35.767748 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 22:46:35.767795 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260929 22:46:35.768523 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22247
I20260929 22:46:35.768617 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:46:35.768606 22375 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45251
I20260929 22:46:35.768712 22375 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:35.768841 12398 external_mini_cluster.cc:1428] Setting key d2a92277a81007d892edb09ca953634a
I20260929 22:46:35.768857 22375 heartbeater.cc:511] Master 127.12.27.190:45251 requested a full tablet report, sending...
I20260929 22:46:35.769447 22186 ts_manager.cc:194] Registered new tserver with Master: 5d2e1716003940f285a27f6cabd35394 (127.12.27.129:40497)
I20260929 22:46:35.769913 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45251
--builtin_ntp_servers=127.12.27.148:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:46:35.850427 22378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.850672 22378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.850716 22378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.851917 22378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.851984 22378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.852028 22378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:46:35.853411 22378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.853672 22378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.853971 22378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:46:35.859676 22378 server_base.cc:1034] running on GCE node
W20260929 22:46:35.859630 22386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.859670 22383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.859647 22384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.860129 22378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.860399 22378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.861646 22378 hybrid_clock.cc:648] HybridClock initialized: now 1790721995861625 us; error 38 us; skew 500 ppm
I20260929 22:46:35.863091 22378 webserver.cc:460] Webserver started at http://127.12.27.130:44585/ using document root <none> and password file <none>
I20260929 22:46:35.863379 22378 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.863456 22378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.863615 22378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.864804 22378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "d1f305178cc04503a0707118bbfeca76"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "2d52a4c76d2363a6ea0d1abbc234d0ae"
server_key_iv: "bed955d29cee58e19690be30a583e6b5"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.865185 22378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "d1f305178cc04503a0707118bbfeca76"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "2d52a4c76d2363a6ea0d1abbc234d0ae"
server_key_iv: "bed955d29cee58e19690be30a583e6b5"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.866498 22378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:46:35.867211 22392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.867385 22378 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:35.867478 22378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "d1f305178cc04503a0707118bbfeca76"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "2d52a4c76d2363a6ea0d1abbc234d0ae"
server_key_iv: "bed955d29cee58e19690be30a583e6b5"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.867560 22378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.870971 22378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.871246 22378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.871388 22378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.871596 22378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:35.872007 22378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:35.872084 22378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.872129 22378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:35.872160 22378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.877935 22378 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:44125
I20260929 22:46:35.877974 22505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:44125 every 8 connection(s)
I20260929 22:46:35.878311 22378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:46:35.881444 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.879117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:60985 (local address 127.12.27.190:45251)
0929 22:46:35.879186 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.879188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.879365 (+ 177us) server_negotiation.cc:407] Connection header received
0929 22:46:35.879903 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.879905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.879911 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.879977 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.881210 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.881212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.881212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.881216 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.881232 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.881237 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.881294 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.881380 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.881393 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:46:35.881641 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.879035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45251 (local address 127.12.27.130:60985)
0929 22:46:35.879233 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:35.879273 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:35.879799 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:35.880049 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:35.880053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:35.880060 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:35.881048 (+ 988us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:46:35.881048 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:35.881075 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:46:35.881102 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:35.881305 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:35.881309 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:35.881311 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:46:35.881369 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:46:35.881416 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260929 22:46:35.882136 22506 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45251
I20260929 22:46:35.882216 22506 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:35.882359 22506 heartbeater.cc:511] Master 127.12.27.190:45251 requested a full tablet report, sending...
I20260929 22:46:35.882753 22186 ts_manager.cc:194] Registered new tserver with Master: d1f305178cc04503a0707118bbfeca76 (127.12.27.130:44125)
I20260929 22:46:35.884514 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22378
I20260929 22:46:35.884595 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:46:35.884795 12398 external_mini_cluster.cc:1428] Setting key 07788eed4709498cc0273091e81efa84
I20260929 22:46:35.885983 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45251
--builtin_ntp_servers=127.12.27.148:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 22:46:35.966920 22509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:35.967130 22509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:35.967154 22509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:35.968259 22509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:35.968293 22509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:35.968319 22509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:46:35.969563 22509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:35.969772 22509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:35.970077 22509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:46:35.975245 22509 server_base.cc:1034] running on GCE node
W20260929 22:46:35.975220 22517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.975229 22514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:35.975234 22515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:35.975752 22509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:35.976032 22509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:35.977226 22509 hybrid_clock.cc:648] HybridClock initialized: now 1790721995977218 us; error 36 us; skew 500 ppm
I20260929 22:46:35.978507 22509 webserver.cc:460] Webserver started at http://127.12.27.131:33853/ using document root <none> and password file <none>
I20260929 22:46:35.978823 22509 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:35.978902 22509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:35.979067 22509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:35.980252 22509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "25c87d129b214936b1be0cf2dae6ce35"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "e17fa079760e3ecdbf789c050b2602bb"
server_key_iv: "b58581f4a7c06358eeee5b24f5cbb8af"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.980624 22509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "25c87d129b214936b1be0cf2dae6ce35"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "e17fa079760e3ecdbf789c050b2602bb"
server_key_iv: "b58581f4a7c06358eeee5b24f5cbb8af"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.981936 22509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:46:35.982697 22523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.982919 22509 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:35.983018 22509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "25c87d129b214936b1be0cf2dae6ce35"
format_stamp: "Formatted at 2026-09-29 22:46:35 on dist-test-slave-00d6"
server_key: "e17fa079760e3ecdbf789c050b2602bb"
server_key_iv: "b58581f4a7c06358eeee5b24f5cbb8af"
server_key_version: "encryptionkey@0"
I20260929 22:46:35.983105 22509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:35.986495 22509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:35.986764 22509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:35.986907 22509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:35.987118 22509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:35.987450 22509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:35.987507 22509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.987546 22509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:35.987573 22509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:35.993965 22509 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38279
I20260929 22:46:35.994010 22636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38279 every 8 connection(s)
I20260929 22:46:35.994369 22509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:46:35.997823 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.995115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:43791 (local address 127.12.27.190:45251)
0929 22:46:35.995227 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:35.995230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:35.995515 (+ 285us) server_negotiation.cc:407] Connection header received
0929 22:46:35.996126 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:35.996128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:35.996135 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:35.996201 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:35.997503 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:35.997504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:35.997505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:46:35.997510 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:35.997527 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:46:35.997532 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:35.997614 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:35.997706 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:46:35.997724 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260929 22:46:35.997987 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:35.995089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45251 (local address 127.12.27.131:43791)
0929 22:46:35.995350 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:35.995412 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:35.996001 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:35.996282 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:35.996286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:35.996296 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:35.997330 (+ 1034us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:46:35.997331 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:35.997361 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:46:35.997391 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:35.997610 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:35.997616 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:35.997620 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:35.997694 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:46:35.997760 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":113,"threads_started":1}
I20260929 22:46:35.998489 22637 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45251
I20260929 22:46:35.998587 22637 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:35.998736 22637 heartbeater.cc:511] Master 127.12.27.190:45251 requested a full tablet report, sending...
I20260929 22:46:35.999173 22186 ts_manager.cc:194] Registered new tserver with Master: 25c87d129b214936b1be0cf2dae6ce35 (127.12.27.131:38279)
I20260929 22:46:36.000608 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22509
I20260929 22:46:36.000723 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:46:36.000949 12398 external_mini_cluster.cc:1428] Setting key cb558a535c2414e79552b62f210c2891
I20260929 22:46:36.001791 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 22:46:36.003701 22228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:46:36.003128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41144 (local address 127.12.27.190:45251)
0929 22:46:36.003198 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:36.003200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:36.003320 (+ 120us) server_negotiation.cc:407] Connection header received
0929 22:46:36.003400 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:36.003401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:36.003406 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:36.003474 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:36.003588 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41144: BlockingRecv error: recv got EOF from 127.0.0.1:41144 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:46:36.003762 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22247
I20260929 22:46:36.009505 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22378
I20260929 22:46:36.013873 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22509
I20260929 22:46:36.018010 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22156
2026-09-29T22:46:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (541 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:46:36 dist-test-slave-00d6 krb5kdc[22647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:46:36 dist-test-slave-00d6 krb5kdc[22647](info): set up 2 sockets
Sep 29 22:46:36 dist-test-slave-00d6 krb5kdc[22647](info): commencing operation
krb5kdc: starting...
W20260929 22:46:37.064985 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:46:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:46:37.182874 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:32993
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:32993
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:37.262849 22660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:37.263057 22660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:37.263079 22660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:37.264286 22660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:46:37.264328 22660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:37.264343 22660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:37.264356 22660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:46:37.264413 22660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:46:37.265897 22660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:32993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:32993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:37.266158 22660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:37.266386 22660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:37.271461 22668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.271449 22666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.271449 22665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:37.271476 22660 server_base.cc:1034] running on GCE node
I20260929 22:46:37.271994 22660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:37.272292 22660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:37.273435 22660 hybrid_clock.cc:648] HybridClock initialized: now 1790721997273414 us; error 34 us; skew 500 ppm
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:37.276121 22660 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:46:37.276608 22660 webserver.cc:460] Webserver started at http://127.12.27.190:35339/ using document root <none> and password file <none>
I20260929 22:46:37.276861 22660 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:37.276911 22660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:37.277062 22660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:37.278110 22660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "1923f140b91f4411963586fef9702a5e"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "5fad90a40db4c2ce685a99fc0f9544d1"
server_key_iv: "80d1db223109808b553b99ef80e680d2"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.278470 22660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "1923f140b91f4411963586fef9702a5e"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "5fad90a40db4c2ce685a99fc0f9544d1"
server_key_iv: "80d1db223109808b553b99ef80e680d2"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.279867 22660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:37.280665 22675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.280844 22660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:37.280944 22660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1923f140b91f4411963586fef9702a5e"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "5fad90a40db4c2ce685a99fc0f9544d1"
server_key_iv: "80d1db223109808b553b99ef80e680d2"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.281015 22660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:37.297219 22660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:37.299219 22660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:37.299372 22660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:37.303413 22660 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:32993
I20260929 22:46:37.303452 22727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:32993 every 8 connection(s)
I20260929 22:46:37.303845 22660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:46:37.304931 22728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:37.307371 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22660
I20260929 22:46:37.307396 22728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e: Bootstrap starting.
I20260929 22:46:37.307474 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:46:37.307710 12398 external_mini_cluster.cc:1428] Setting key 7587ba8e279ee8e44270b3d625bf6efb
I20260929 22:46:37.308209 22728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:37.308557 22728 log.cc:824] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:37.309314 22728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e: No bootstrap required, opened a new log
I20260929 22:46:37.311854 22728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1923f140b91f4411963586fef9702a5e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32993 } }
I20260929 22:46:37.312029 22728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:37.312062 22728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1923f140b91f4411963586fef9702a5e, State: Initialized, Role: FOLLOWER
I20260929 22:46:37.312197 22728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1923f140b91f4411963586fef9702a5e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32993 } }
I20260929 22:46:37.312312 22728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:46:37.312382 22728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:46:37.312434 22728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:37.313088 22728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1923f140b91f4411963586fef9702a5e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32993 } }
I20260929 22:46:37.313215 22728 leader_election.cc:302] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1923f140b91f4411963586fef9702a5e; no voters:
I20260929 22:46:37.313390 22728 leader_election.cc:288] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:46:37.313414 22733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:37.313596 22733 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [term 1 LEADER]: Becoming Leader. State: Replica: 1923f140b91f4411963586fef9702a5e, State: Running, Role: LEADER
I20260929 22:46:37.313665 22728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:46:37.313798 22733 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1923f140b91f4411963586fef9702a5e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32993 } }
I20260929 22:46:37.314275 22734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1923f140b91f4411963586fef9702a5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1923f140b91f4411963586fef9702a5e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32993 } } }
I20260929 22:46:37.314292 22735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1923f140b91f4411963586fef9702a5e. Latest consensus state: current_term: 1 leader_uuid: "1923f140b91f4411963586fef9702a5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1923f140b91f4411963586fef9702a5e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 32993 } } }
I20260929 22:46:37.314363 22734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [sys.catalog]: This master's current role is: LEADER
I20260929 22:46:37.314390 22735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e [sys.catalog]: This master's current role is: LEADER
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:46:37.315395 22742 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:46:37.315917 22742 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:46:37.317600 22742 catalog_manager.cc:1347] Generated new cluster ID: e65cb9253f3e46799e31348c61c6177d
I20260929 22:46:37.317668 22742 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:46:37.319527 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.308282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46536 (local address 127.12.27.190:32993)
0929 22:46:37.308466 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.308481 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.308505 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:46:37.309154 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.309162 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.309216 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.309333 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:37.310194 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.311081 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.312313 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.312856 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.312948 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.315978 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:37.315982 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:37.315982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:37.315994 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:37.317986 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.318340 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.318344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.318344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.318435 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.318648 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.318649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.318650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.318910 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:37.319069 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.319166 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.319310 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260929 22:46:37.328431 22742 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:46:37.328930 22742 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:46:37.333979 22742 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e: Generated new TSK 0
I20260929 22:46:37.334167 22742 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:46:37.367209 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32993
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:37.471411 22754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:37.471676 22754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:37.471724 22754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:37.472941 22754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:37.473007 22754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:37.473053 22754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:46:37.474561 22754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:37.474823 22754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:37.475052 22754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:37.480886 22762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.480892 22760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.480926 22759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:37.481062 22754 server_base.cc:1034] running on GCE node
I20260929 22:46:37.481308 22754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:37.481521 22754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:37.482658 22754 hybrid_clock.cc:648] HybridClock initialized: now 1790721997482646 us; error 27 us; skew 500 ppm
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:37.485356 22754 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:46:37.485770 22754 webserver.cc:460] Webserver started at http://127.12.27.129:42157/ using document root <none> and password file <none>
I20260929 22:46:37.486027 22754 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:37.486071 22754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:37.486192 22754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:37.487236 22754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "56ed177b6fbb4fe8b087a55f2061ec3f"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "198190e52dee87fe1bc4827030e72348"
server_key_iv: "8487496cdd46f2d7331745bb79d4c946"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.487572 22754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "56ed177b6fbb4fe8b087a55f2061ec3f"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "198190e52dee87fe1bc4827030e72348"
server_key_iv: "8487496cdd46f2d7331745bb79d4c946"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.488924 22754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:46:37.489631 22769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.489799 22754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:46:37.489890 22754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "56ed177b6fbb4fe8b087a55f2061ec3f"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "198190e52dee87fe1bc4827030e72348"
server_key_iv: "8487496cdd46f2d7331745bb79d4c946"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.489964 22754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:37.499454 22754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:37.501734 22754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:37.501905 22754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:37.502125 22754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:37.502460 22754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:37.502509 22754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.502548 22754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:37.502576 22754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.508201 22754 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:34543
I20260929 22:46:37.508302 22882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:34543 every 8 connection(s)
I20260929 22:46:37.508581 22754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:46:37.512634 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22754
I20260929 22:46:37.512806 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:46:37.513041 12398 external_mini_cluster.cc:1428] Setting key 33abbacf07c4add431eea85a1acd0962
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:46:37.518774 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.509409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:47539 (local address 127.12.27.190:32993)
0929 22:46:37.509454 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.509456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.509529 (+ 73us) server_negotiation.cc:407] Connection header received
0929 22:46:37.510005 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.510006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.510016 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.510080 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:37.510968 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.511520 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.512599 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.512905 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.512966 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.515754 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:37.515757 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:37.515757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:37.515764 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:37.517250 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.517771 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.517772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.517773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.517824 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.518119 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.518120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.518120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.518225 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:37.518278 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.518629 (+ 351us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.518697 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:46:37.519088 22885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.509258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:32993 (local address 127.12.27.129:47539)
0929 22:46:37.509410 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.509453 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.509925 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.510135 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.510138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.510676 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:37.510873 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.510877 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.511615 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.511617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.512500 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.512503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.512991 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.512992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.513140 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.513747 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:37.513757 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:37.515608 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:37.517336 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:37.517344 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:37.517347 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:37.517670 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:37.517892 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:37.517893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:37.517893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:37.518051 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:37.518290 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:37.518296 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:37.518476 (+ 180us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.518608 (+ 132us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.518807 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260929 22:46:37.519670 22883 heartbeater.cc:347] Connected to a master server at 127.12.27.190:32993
I20260929 22:46:37.519785 22883 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:37.519968 22883 heartbeater.cc:511] Master 127.12.27.190:32993 requested a full tablet report, sending...
I20260929 22:46:37.520538 22692 ts_manager.cc:194] Registered new tserver with Master: 56ed177b6fbb4fe8b087a55f2061ec3f (127.12.27.129:34543)
I20260929 22:46:37.521526 22692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:47539
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:46:37.539040 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32993
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:37.619825 22888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:37.620033 22888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:37.620059 22888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:37.621204 22888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:37.621243 22888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:37.621270 22888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:46:37.622678 22888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:37.622869 22888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:37.623051 22888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:46:37.628006 22893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.628036 22894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:37.628202 22888 server_base.cc:1034] running on GCE node
W20260929 22:46:37.628018 22896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:37.628470 22888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:37.628772 22888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:37.629941 22888 hybrid_clock.cc:648] HybridClock initialized: now 1790721997629925 us; error 26 us; skew 500 ppm
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:37.637956 22888 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:46:37.638473 22888 webserver.cc:460] Webserver started at http://127.12.27.130:33809/ using document root <none> and password file <none>
I20260929 22:46:37.638689 22888 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:37.638758 22888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:37.638900 22888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:37.639988 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "8e12d04b44194847a75c7b892e85166a"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "7006fe84f1b2b54cf31579807ee113cc"
server_key_iv: "dbe4f7e6dee57d4f344214caf9e40676"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.640341 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "8e12d04b44194847a75c7b892e85166a"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "7006fe84f1b2b54cf31579807ee113cc"
server_key_iv: "dbe4f7e6dee57d4f344214caf9e40676"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.641630 22888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:46:37.642468 22903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.642779 22888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:37.642902 22888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "8e12d04b44194847a75c7b892e85166a"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "7006fe84f1b2b54cf31579807ee113cc"
server_key_iv: "dbe4f7e6dee57d4f344214caf9e40676"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.642976 22888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:37.663743 22888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:37.665616 22888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:37.665789 22888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:37.666023 22888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:37.666355 22888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:37.666407 22888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.666472 22888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:37.666503 22888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.672328 22888 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:37137
I20260929 22:46:37.672369 23016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:37137 every 8 connection(s)
I20260929 22:46:37.672694 22888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:46:37.674078 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 22888
I20260929 22:46:37.674177 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:46:37.674360 12398 external_mini_cluster.cc:1428] Setting key 5a2cd4aedb989f66d93f53aa54cb39e6
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
I20260929 22:46:37.683380 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.673356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:53755 (local address 127.12.27.190:32993)
0929 22:46:37.673435 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.673438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.673615 (+ 177us) server_negotiation.cc:407] Connection header received
0929 22:46:37.674200 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.674202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.674213 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.674261 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:37.675362 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.675935 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.677445 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.677651 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.677762 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.680401 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:37.680403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:37.680403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:37.680409 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:37.681837 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.682366 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.682367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.682368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.682424 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.682749 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.682750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.682751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.682871 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:37.682926 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.683247 (+ 321us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.683315 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 22:46:37.683615 23019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.673331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:32993 (local address 127.12.27.130:53755)
0929 22:46:37.673499 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.673534 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.674093 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.674330 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.674333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.675068 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:37.675274 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.675280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.676023 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.676024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.677337 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.677340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.677738 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.677739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.677913 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.678518 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:37.678528 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:37.680311 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:37.681922 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:37.681928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:37.681931 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:37.682277 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:37.682494 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:37.682495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:37.682496 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:37.682626 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:37.682936 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:37.682942 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:37.683107 (+ 165us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.683216 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.683332 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260929 22:46:37.684109 23017 heartbeater.cc:347] Connected to a master server at 127.12.27.190:32993
I20260929 22:46:37.684208 23017 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:37.684381 23017 heartbeater.cc:511] Master 127.12.27.190:32993 requested a full tablet report, sending...
I20260929 22:46:37.684937 22692 ts_manager.cc:194] Registered new tserver with Master: 8e12d04b44194847a75c7b892e85166a (127.12.27.130:37137)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
I20260929 22:46:37.685462 22692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:53755
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:46:37.699134 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32993
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:35527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:46:37.778502 23022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:46:37.778699 23022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:46:37.778723 23022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:46:37.779937 23022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:46:37.779980 23022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:46:37.780006 23022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:46:37.781543 23022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:35527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:32993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:46:37.781791 23022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:46:37.782016 23022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:46:37.787132 23022 server_base.cc:1034] running on GCE node
W20260929 22:46:37.787036 23027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.787036 23028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:46:37.787060 23030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:46:37.787425 23022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:46:37.787736 23022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:46:37.788882 23022 hybrid_clock.cc:648] HybridClock initialized: now 1790721997788866 us; error 32 us; skew 500 ppm
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:46:37.791440 23022 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:46:37.791921 23022 webserver.cc:460] Webserver started at http://127.12.27.131:40155/ using document root <none> and password file <none>
I20260929 22:46:37.792160 23022 fs_manager.cc:359] Metadata directory not provided
I20260929 22:46:37.792223 23022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:46:37.792358 23022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:46:37.793481 23022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "2ea8a853ac17407bb84d347b1dd69909"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "4d678655c8e33257388f27bb951ad5a3"
server_key_iv: "f04ed7174f049ec0887b855ce670cf37"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.793826 23022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "2ea8a853ac17407bb84d347b1dd69909"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "4d678655c8e33257388f27bb951ad5a3"
server_key_iv: "f04ed7174f049ec0887b855ce670cf37"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.795089 23022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:46:37.795881 23037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.796057 23022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:46:37.796154 23022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "2ea8a853ac17407bb84d347b1dd69909"
format_stamp: "Formatted at 2026-09-29 22:46:37 on dist-test-slave-00d6"
server_key: "4d678655c8e33257388f27bb951ad5a3"
server_key_iv: "f04ed7174f049ec0887b855ce670cf37"
server_key_version: "encryptionkey@0"
I20260929 22:46:37.796234 23022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:46:37.806206 23022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:46:37.808089 23022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:46:37.808233 23022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:46:37.808429 23022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:46:37.808705 23022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:46:37.808755 23022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.808787 23022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:46:37.808813 23022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:46:37.814561 23022 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:35189
I20260929 22:46:37.814642 23150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:35189 every 8 connection(s)
I20260929 22:46:37.814942 23022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[22647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721997, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:46:37.823292 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.815697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:39035 (local address 127.12.27.190:32993)
0929 22:46:37.815743 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.815745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.815884 (+ 139us) server_negotiation.cc:407] Connection header received
0929 22:46:37.816382 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.816384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.816394 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.816452 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:37.817280 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.817757 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.818678 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.818864 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.818915 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.820916 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:37.820917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:37.820918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:37.820924 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:37.822104 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.822468 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.822469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.822469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.822517 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.822747 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.822748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.822748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.822849 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:37.822901 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.823155 (+ 254us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.823230 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:46:37.823482 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.815615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:32993 (local address 127.12.27.131:39035)
0929 22:46:37.815777 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.815817 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.816283 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.816499 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.816502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.817030 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:46:37.817208 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.817212 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.817829 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.817830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.818610 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.818612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.818929 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.818930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.819020 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.819503 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:46:37.819511 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:46:37.820837 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:46:37.822169 (+ 1332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:37.822174 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:37.822176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:37.822407 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:37.822571 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:46:37.822572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:46:37.822572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:46:37.822661 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:46:37.822901 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:46:37.822904 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:46:37.823027 (+ 123us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.823126 (+ 99us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.823234 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260929 22:46:37.823764 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 23022
I20260929 22:46:37.823874 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:46:37.824040 23151 heartbeater.cc:347] Connected to a master server at 127.12.27.190:32993
I20260929 22:46:37.824062 12398 external_mini_cluster.cc:1428] Setting key 674dac7fe2c9187d12a50d91bf30ff89
I20260929 22:46:37.824118 23151 heartbeater.cc:464] Registering TS with master...
I20260929 22:46:37.824301 23151 heartbeater.cc:511] Master 127.12.27.190:32993 requested a full tablet report, sending...
I20260929 22:46:37.824635 22692 ts_manager.cc:194] Registered new tserver with Master: 2ea8a853ac17407bb84d347b1dd69909 (127.12.27.131:35189)
I20260929 22:46:37.824860 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:46:37.825081 22692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:39035
I20260929 22:46:37.831368 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.826186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46550 (local address 127.12.27.190:32993)
0929 22:46:37.826238 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.826240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.826302 (+ 62us) server_negotiation.cc:407] Connection header received
0929 22:46:37.826357 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.826358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.826365 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.826402 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:46:37.826873 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.827315 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.828064 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.828250 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.828304 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.829438 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:46:37.829439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:46:37.829440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:46:37.829445 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:46:37.830526 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.830807 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.830807 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.830808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.830854 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:46:37.830994 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:46:37.830995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:46:37.830995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:46:37.831115 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:46:37.831183 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.831262 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.831313 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:46:37.832921 22692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46550:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:46:37.834582 22692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:46:37.840734 23165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.836818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34036 (local address 127.12.27.129:34543)
0929 22:46:37.837147 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.837151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.837161 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:46:37.837199 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.837201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.837216 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.837307 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:37.837466 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.838293 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.839723 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.840308 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.840388 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.840445 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.840605 (+ 160us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.840645 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":79,"threads_started":1}
I20260929 22:46:37.840873 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.836730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:35189 (local address 127.0.0.1:41854)
0929 22:46:37.837075 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.837083 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.837133 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.837360 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.837360 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.837365 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:37.837430 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.837432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.838712 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.838713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.839576 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.839579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.840502 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.840503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.840565 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.840569 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.840617 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.840660 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":51,"thread_start_us":84,"threads_started":1}
I20260929 22:46:37.841001 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.836727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37137 (local address 127.0.0.1:51238)
0929 22:46:37.836972 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.836982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.837024 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.837359 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.837360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.837362 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:37.837429 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.837431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.838772 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.838773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.839887 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.839889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.840726 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.840726 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.840786 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.840790 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.840844 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.840876 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":4,"thread_start_us":81,"threads_started":1}
I20260929 22:46:37.841063 23167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.836953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.12.27.130:37137)
0929 22:46:37.837150 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.837153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.837162 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:46:37.837198 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.837199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.837215 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.837509 (+ 294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:37.837579 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.838686 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.839967 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.840664 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.840724 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.840770 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.840926 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.840972 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
I20260929 22:46:37.841272 23166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.836923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41854 (local address 127.12.27.131:35189)
0929 22:46:37.837086 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.837090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.837128 (+ 38us) server_negotiation.cc:407] Connection header received
0929 22:46:37.837197 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.837199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.837215 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.837298 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:37.837508 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.838601 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.839683 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.840351 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.840418 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.840467 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.841176 (+ 709us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.841218 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":75,"threads_started":1}
I20260929 22:46:37.841362 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.836722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:34543 (local address 127.0.0.1:34036)
0929 22:46:37.836869 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.836909 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.836973 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.837309 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.837312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.837314 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:37.837377 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.837382 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.838388 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.838389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.839610 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.839613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.840400 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.840401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.840480 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.840493 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.840588 (+ 95us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.840640 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":45,"threads_started":1}
I20260929 22:46:37.841751 22951 tablet_service.cc:1467] Processing CreateTablet for tablet 50d4f484cfee4c66b7ab7585ef084487 (DEFAULT_TABLE table=test-table [id=ca021bec02e840d3b82af49e45411706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:37.841961 23085 tablet_service.cc:1467] Processing CreateTablet for tablet 50d4f484cfee4c66b7ab7585ef084487 (DEFAULT_TABLE table=test-table [id=ca021bec02e840d3b82af49e45411706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:37.842027 22817 tablet_service.cc:1467] Processing CreateTablet for tablet 50d4f484cfee4c66b7ab7585ef084487 (DEFAULT_TABLE table=test-table [id=ca021bec02e840d3b82af49e45411706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:46:37.842129 22951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d4f484cfee4c66b7ab7585ef084487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:37.842253 23085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d4f484cfee4c66b7ab7585ef084487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:37.842307 22817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d4f484cfee4c66b7ab7585ef084487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:46:37.844802 23168 tablet_bootstrap.cc:492] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Bootstrap starting.
I20260929 22:46:37.845366 23169 tablet_bootstrap.cc:492] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: Bootstrap starting.
I20260929 22:46:37.845984 23168 tablet_bootstrap.cc:654] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:37.845984 23169 tablet_bootstrap.cc:654] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:37.846639 23168 log.cc:824] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:37.846628 23169 log.cc:824] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:37.846961 23170 tablet_bootstrap.cc:492] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Bootstrap starting.
I20260929 22:46:37.847412 23168 tablet_bootstrap.cc:492] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: No bootstrap required, opened a new log
I20260929 22:46:37.847486 23168 ts_tablet_manager.cc:1397] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:46:37.847522 23169 tablet_bootstrap.cc:492] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: No bootstrap required, opened a new log
I20260929 22:46:37.847589 23169 ts_tablet_manager.cc:1397] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:46:37.847589 23170 tablet_bootstrap.cc:654] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Neither blocks nor log segments found. Creating new log.
I20260929 22:46:37.848150 23170 log.cc:824] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:46:37.848872 23170 tablet_bootstrap.cc:492] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: No bootstrap required, opened a new log
I20260929 22:46:37.848943 23170 ts_tablet_manager.cc:1397] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:46:37.849380 23168 raft_consensus.cc:348] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.849529 23168 raft_consensus.cc:374] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:37.849571 23168 raft_consensus.cc:729] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea8a853ac17407bb84d347b1dd69909, State: Initialized, Role: FOLLOWER
I20260929 22:46:37.849466 23169 raft_consensus.cc:348] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.849615 23169 raft_consensus.cc:374] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:37.849658 23169 raft_consensus.cc:729] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ed177b6fbb4fe8b087a55f2061ec3f, State: Initialized, Role: FOLLOWER
I20260929 22:46:37.849709 23168 consensus_queue.cc:260] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.849779 23169 consensus_queue.cc:260] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.850054 23168 ts_tablet_manager.cc:1428] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:46:37.850060 22883 heartbeater.cc:503] Master 127.12.27.190:32993 was elected leader, sending a full tablet report...
I20260929 22:46:37.850045 23169 ts_tablet_manager.cc:1428] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:46:37.850160 23151 heartbeater.cc:503] Master 127.12.27.190:32993 was elected leader, sending a full tablet report...
I20260929 22:46:37.850814 23170 raft_consensus.cc:348] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.850967 23170 raft_consensus.cc:374] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:46:37.851019 23170 raft_consensus.cc:729] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e12d04b44194847a75c7b892e85166a, State: Initialized, Role: FOLLOWER
I20260929 22:46:37.851152 23170 consensus_queue.cc:260] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.851425 23170 ts_tablet_manager.cc:1428] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:46:37.851476 23017 heartbeater.cc:503] Master 127.12.27.190:32993 was elected leader, sending a full tablet report...
I20260929 22:46:37.884426 23176 raft_consensus.cc:482] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:46:37.884609 23176 raft_consensus.cc:504] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.885033 23176 leader_election.cc:288] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56ed177b6fbb4fe8b087a55f2061ec3f (127.12.27.129:34543), 2ea8a853ac17407bb84d347b1dd69909 (127.12.27.131:35189)
I20260929 22:46:37.887754 23165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.885252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:33107 (local address 127.12.27.129:34543)
0929 22:46:37.885316 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.885318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.885326 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:46:37.885352 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.885353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.885365 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.885428 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:37.885593 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.886054 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.887026 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.887400 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.887482 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.887490 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.887654 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.887687 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:46:37.887754 23019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.885179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:34543 (local address 127.12.27.130:33107)
0929 22:46:37.885231 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.885243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.885284 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.885436 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.885437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.885438 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:37.885518 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.885520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.886142 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.886143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.886933 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.886934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.887477 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.887478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.887555 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.887559 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.887627 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.887684 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 22:46:37.887835 23166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.885282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:55627 (local address 127.12.27.131:35189)
0929 22:46:37.885360 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.885362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.885414 (+ 52us) server_negotiation.cc:407] Connection header received
0929 22:46:37.885485 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.885486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.885495 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.885564 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:46:37.885714 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.886174 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.887080 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.887454 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.887538 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.887546 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.887716 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.887754 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260929 22:46:37.887897 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.885183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:35189 (local address 127.12.27.130:55627)
0929 22:46:37.885355 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.885366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:46:37.885430 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:46:37.885565 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:46:37.885566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:46:37.885568 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:46:37.885636 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.885638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.886255 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.886256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.886989 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:46:37.886990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.887539 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.887540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:46:37.887607 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.887612 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:46:37.887709 (+ 97us) client_negotiation.cc:240] Negotiation successful
0929 22:46:37.887750 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":10,"thread_start_us":105,"threads_started":1}
I20260929 22:46:37.888108 22837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d4f484cfee4c66b7ab7585ef084487" candidate_uuid: "8e12d04b44194847a75c7b892e85166a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" is_pre_election: true
I20260929 22:46:37.888236 22837 raft_consensus.cc:2454] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e12d04b44194847a75c7b892e85166a in term 0.
I20260929 22:46:37.888484 22907 leader_election.cc:302] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56ed177b6fbb4fe8b087a55f2061ec3f, 8e12d04b44194847a75c7b892e85166a; no voters:
I20260929 22:46:37.888500 23105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d4f484cfee4c66b7ab7585ef084487" candidate_uuid: "8e12d04b44194847a75c7b892e85166a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea8a853ac17407bb84d347b1dd69909" is_pre_election: true
I20260929 22:46:37.888646 23105 raft_consensus.cc:2454] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e12d04b44194847a75c7b892e85166a in term 0.
I20260929 22:46:37.888651 23176 raft_consensus.cc:2781] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:46:37.888726 23176 raft_consensus.cc:482] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:46:37.888763 23176 raft_consensus.cc:3037] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:37.889490 23176 raft_consensus.cc:504] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.889626 23176 leader_election.cc:288] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [CANDIDATE]: Term 1 election: Requested vote from peers 56ed177b6fbb4fe8b087a55f2061ec3f (127.12.27.129:34543), 2ea8a853ac17407bb84d347b1dd69909 (127.12.27.131:35189)
I20260929 22:46:37.889789 22837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d4f484cfee4c66b7ab7585ef084487" candidate_uuid: "8e12d04b44194847a75c7b892e85166a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f"
I20260929 22:46:37.889789 23105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d4f484cfee4c66b7ab7585ef084487" candidate_uuid: "8e12d04b44194847a75c7b892e85166a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea8a853ac17407bb84d347b1dd69909"
I20260929 22:46:37.889869 22837 raft_consensus.cc:3037] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:37.889869 23105 raft_consensus.cc:3037] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:46:37.890780 22837 raft_consensus.cc:2454] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e12d04b44194847a75c7b892e85166a in term 1.
I20260929 22:46:37.890780 23105 raft_consensus.cc:2454] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e12d04b44194847a75c7b892e85166a in term 1.
I20260929 22:46:37.890954 22904 leader_election.cc:302] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea8a853ac17407bb84d347b1dd69909, 8e12d04b44194847a75c7b892e85166a; no voters:
I20260929 22:46:37.891043 23176 raft_consensus.cc:2781] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:46:37.891194 23176 raft_consensus.cc:686] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 1 LEADER]: Becoming Leader. State: Replica: 8e12d04b44194847a75c7b892e85166a, State: Running, Role: LEADER
I20260929 22:46:37.891299 23176 consensus_queue.cc:237] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } }
I20260929 22:46:37.892143 22691 catalog_manager.cc:5495] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e12d04b44194847a75c7b892e85166a (127.12.27.130). New cstate: current_term: 1 leader_uuid: "8e12d04b44194847a75c7b892e85166a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e12d04b44194847a75c7b892e85166a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37137 } health_report { overall_health: HEALTHY } } }
I20260929 22:46:37.898139 23167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.895977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51242 (local address 127.12.27.130:37137)
0929 22:46:37.896025 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:46:37.896026 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:46:37.896059 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:46:37.896130 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:46:37.896131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:46:37.896144 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:46:37.896200 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:46:37.896300 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.896733 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.897435 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:46:37.897619 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:46:37.897676 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:46:37.897846 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:46:37.897930 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:46:37.897988 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:46:37.898020 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 22:46:37.898035 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:46:37.900000 23105 raft_consensus.cc:1261] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 1 FOLLOWER]: Refusing update from remote peer 8e12d04b44194847a75c7b892e85166a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:37.900000 22837 raft_consensus.cc:1261] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 1 FOLLOWER]: Refusing update from remote peer 8e12d04b44194847a75c7b892e85166a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:46:37.900349 23178 consensus_queue.cc:1035] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea8a853ac17407bb84d347b1dd69909" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:37.900452 23176 consensus_queue.cc:1035] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ed177b6fbb4fe8b087a55f2061ec3f" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 34543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:46:37.903091 23182 mvcc.cc:205] Tried to move back new op lower bound from 7334797303395565568 to 7334797303363334144. Current Snapshot: MvccSnapshot[applied={T|T < 7334797303395565568}]
I20260929 22:46:37.903865 23183 mvcc.cc:205] Tried to move back new op lower bound from 7334797303395565568 to 7334797303363334144. Current Snapshot: MvccSnapshot[applied={T|T < 7334797303395565568 or (T in {7334797303395565568})}]
I20260929 22:46:37.904928 22692 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:37.905031 22692 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:46:37.905736 22692 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1923f140b91f4411963586fef9702a5e: Sending DeleteTablet for 3 replicas of tablet 50d4f484cfee4c66b7ab7585ef084487
I20260929 22:46:37.906068 23085 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d4f484cfee4c66b7ab7585ef084487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:37 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:41854
I20260929 22:46:37.906056 22951 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d4f484cfee4c66b7ab7585ef084487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:37 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:51238
I20260929 22:46:37.906273 22817 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d4f484cfee4c66b7ab7585ef084487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:46:37 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:34036
I20260929 22:46:37.906296 23191 tablet_replica.cc:330] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: stopping tablet replica
I20260929 22:46:37.906389 23191 raft_consensus.cc:2229] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:46:37.906482 23191 raft_consensus.cc:2258] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:37.906507 23193 tablet_replica.cc:330] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f: stopping tablet replica
I20260929 22:46:37.906634 23192 tablet_replica.cc:330] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: stopping tablet replica
I20260929 22:46:37.906713 23193 raft_consensus.cc:2229] T 50d4f484cfee4c66b7ab7585ef084487 P 56ed177b6fbb4fe8b087a55f2061ec3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:37.906725 23192 raft_consensus.cc:2229] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:46:37.906814 23192 raft_consensus.cc:2258] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:46:37.906822 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22754
I20260929 22:46:37.907785 23192 ts_tablet_manager.cc:1905] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:37.909173 23191 ts_tablet_manager.cc:1905] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:46:37.909530 23192 ts_tablet_manager.cc:1918] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:37.909606 23192 log.cc:1196] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/50d4f484cfee4c66b7ab7585ef084487
I20260929 22:46:37.909888 23192 ts_tablet_manager.cc:1939] T 50d4f484cfee4c66b7ab7585ef084487 P 2ea8a853ac17407bb84d347b1dd69909: Deleting consensus metadata
I20260929 22:46:37.910317 22676 catalog_manager.cc:4841] TS 2ea8a853ac17407bb84d347b1dd69909 (127.12.27.131:35189): tablet 50d4f484cfee4c66b7ab7585ef084487 (table test-table [id=ca021bec02e840d3b82af49e45411706]) successfully deleted
I20260929 22:46:37.911404 23191 ts_tablet_manager.cc:1918] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:46:37.911532 23191 log.cc:1196] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/50d4f484cfee4c66b7ab7585ef084487
I20260929 22:46:37.911938 23191 ts_tablet_manager.cc:1939] T 50d4f484cfee4c66b7ab7585ef084487 P 8e12d04b44194847a75c7b892e85166a: Deleting consensus metadata
I20260929 22:46:37.912358 22678 catalog_manager.cc:4841] TS 8e12d04b44194847a75c7b892e85166a (127.12.27.130:37137): tablet 50d4f484cfee4c66b7ab7585ef084487 (table test-table [id=ca021bec02e840d3b82af49e45411706]) successfully deleted
W20260929 22:46:37.913301 22679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:34543 (error 108)
I20260929 22:46:37.913792 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:46:37.913655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:34543 (local address 127.0.0.1:34052)
0929 22:46:37.913717 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 22:46:37.913756 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 22:46:37.913861 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22888
W20260929 22:46:37.914964 22679 catalog_manager.cc:4584] TS 56ed177b6fbb4fe8b087a55f2061ec3f (127.12.27.129:34543): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 50d4f484cfee4c66b7ab7585ef084487: Network error: Client connection negotiation failed: client connection to 127.12.27.129:34543: connect: Connection refused (error 111)
I20260929 22:46:37.919116 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 23022
I20260929 22:46:37.925190 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 22660
2026-09-29T22:46:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1908 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[23197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[23197](info): set up 2 sockets
Sep 29 22:46:37 dist-test-slave-00d6 krb5kdc[23197](info): commencing operation
krb5kdc: starting...
W20260929 22:46:38.964430 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:46:39 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790721999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:46:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:46:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/rangeradmin_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/rangeradmin_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/rangerlookup_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/rangerlookup_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
I20260929 22:46:39.134488 12398 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskh9tbJl/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/postgres -l logfile start
2026-09-29 22:46:41.663 UTC [23227] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 22:46:41.663 UTC [23227] LOG: listening on IPv4 address "127.12.27.148", port 55317
2026-09-29 22:46:41.667 UTC [23227] LOG: listening on Unix socket "/tmp/.s.PGSQL.55317"
2026-09-29 22:46:41.702 UTC [23230] LOG: database system was shut down at 2026-09-29 22:46:40 UTC
2026-09-29 22:46:41.706 UTC [23227] LOG: database system is ready to accept connections
I20260929 22:46:42.660221 12398 mini_postgres.cc:96] Postgres bound to 55317
2026-09-29 22:46:42.666 UTC [23238] FATAL: database "slave" does not exist
127.12.27.148:55317 - accepting connections
I20260929 22:46:42.666738 12398 mini_ranger.cc:161] Starting Ranger...
I20260929 22:46:42.681568 12398 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 22:46:43.181214 12398 mini_ranger.cc:87] Created ranger Postgres database
I20260929 22:46:43.181286 12398 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-admin
2026-09-29 22:46:43,466 [I] DB FLAVOR :POSTGRES
2026-09-29 22:46:43,467 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:46:43,467 [I] Checking connection..
2026-09-29 22:46:43,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 22:46:43,735 [I] Checking connection passed.
2026-09-29 22:46:43,735 [I] --------- Verifying version history table ---------
2026-09-29 22:46:43,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:46:44,001 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:46:44,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:46:44,229 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:46:44,229 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 22:46:44,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 22:46:44.496 UTC [23302] WARNING: there is no transaction in progress
2026-09-29 22:46:44,502 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 22:46:44,502 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:46:44,755 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 22:46:44,756 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:46:44,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 22:46:44,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 22:46:45,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-00d6.c.gcp-upstream.internal','N') ;"
2026-09-29 22:46:45,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:46:45,760 [I] Table x_portal_user does not exist in database ranger
2026-09-29 22:46:45,760 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:46:46,022 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 22:46:46,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:46:46,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:46:46,543 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 22:46:46,544 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 22:46:47.522 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.540 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.557 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.574 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.594 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.612 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.671 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.678 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.694 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.705 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.716 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.732 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.742 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.748 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.756 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:47.763 UTC [23410] WARNING: there is no transaction in progress
2026-09-29 22:46:48,425 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 22:46:48,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 22:46:48,684 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 22:46:48,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:46:48,921 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 22:46:48,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:46:49,185 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 22:46:49,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:46:49,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:46:49,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-00d6.c.gcp-upstream.internal';"
2026-09-29 22:46:49,882 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 22:46:49,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 22:46:50,107 [I] DB_PATCHES have already been applied
I20260929 22:46:50.112717 12398 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-admin:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskh9tbJl/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 22:46:50.112775 12398 mini_ranger.cc:193] Using host: 127.12.27.148
I20260929 22:46:50.115743 12398 mini_ranger.cc:227] Ranger admin URL: http://127.12.27.148:52127
Sep 29, 2026 10:46:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:46:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:46:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 10:46:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 10:46:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 10:46:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 10:46:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 22:46:51.205363 12398 mini_ranger.cc:160] Time spent starting Ranger: real 8.539s user 0.000s sys 0.009s
Sep 29, 2026 10:47:11 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 10:47:11 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Sep 29, 2026 10:47:11 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 10:47:11 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 10:47:12 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 22:47:13.166257 12398 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/rangerkms_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/rangerkms_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.27.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.27.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 22:47:13 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722033, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 22:47:13.267854 12398 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 22:47:13.278323 12398 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 22:47:14.177943 12398 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 22:47:14.178026 12398 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms
I20260929 22:47:14.178050 12398 mini_ranger_kms.cc:227] Using postgres at 127.12.27.148:55317
2026-09-29 22:47:14,362 [I] DB FLAVOR :POSTGRES
2026-09-29 22:47:14,362 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:47:14,362 [I] Checking connection
2026-09-29 22:47:14,362 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 22:47:14,611 [I] connection success
2026-09-29 22:47:14,611 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 22:47:14,612 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 22:47:14,612 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 22:47:14,870 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 22:47:14,870 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:47:14,870 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 22:47:14,870 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:55317/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 22:47:15,153 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 22:47:15.633880 12398 mini_ranger_kms.cc:310] Created kms service
I20260929 22:47:15.823813 12398 mini_ranger_kms.cc:326] Created kudu user
I20260929 22:47:15.865850 12398 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 22:47:15 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722033, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:47:16.252063 12398 mini_ranger_kms.cc:384] Added ranger policy
I20260929 22:47:16.252177 12398 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms:/tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 22:47:16.252199 12398 mini_ranger_kms.cc:240] Using host: 127.12.27.148
I20260929 22:47:16.255570 12398 mini_ranger_kms.cc:276] Ranger KMS PID: 23590
I20260929 22:47:16.255748 12398 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.27.148:41997
Sep 29, 2026 10:47:17 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:47:17 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:47:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 10:47:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 10:47:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 10:47:17 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 22:47:18.542989 12398 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.275s user 0.000s sys 0.167s
I20260929 22:47:18.543097 12398 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 22:47:18.543174 12398 mini_ranger_kms.cc:401] 127.12.27.148:41997/kms/v1/keys
Sep 29 22:47:18 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722038, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.27.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 22:47:19 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722038, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.27.148@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
Sep 29 22:47:19 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722038, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.27.148@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
Sep 29 22:47:21 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:47:21.730171 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:35629
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:35629
--ranger_config_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:41997/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:47:21.848513 23641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:47:21.848783 23641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:47:21.848814 23641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:47:21.850441 23641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:47:21.850492 23641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:47:21.850512 23641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:47:21.850529 23641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:47:21.850548 23641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:47:21.852725 23641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.27.148:41997/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:35629
--ranger_config_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:35629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:47:21.852949 23641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:47:21.853219 23641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:47:21.858728 23641 server_base.cc:1034] running on GCE node
W20260929 22:47:21.858798 23646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:21.858915 23649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:21.859066 23647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:47:21.859325 23641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:47:21.859616 23641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:47:21.860829 23641 hybrid_clock.cc:648] HybridClock initialized: now 1790722041860798 us; error 48 us; skew 500 ppm
Sep 29 22:47:21 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722041, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:47:21.863397 23641 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:47:21.863943 23641 webserver.cc:460] Webserver started at http://127.12.27.190:39249/ using document root <none> and password file <none>
I20260929 22:47:21.864181 23641 fs_manager.cc:359] Metadata directory not provided
I20260929 22:47:21.864241 23641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:47:21.864411 23641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:47:21 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722041, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:47:21.909034 23641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "cf398465aa9941b194c87bcfcd5a2723"
format_stamp: "Formatted at 2026-09-29 22:47:21 on dist-test-slave-00d6"
server_key: "cee6f2f8601aac46bf1f3f8ef1c56fb6"
server_key_iv: "e3a95162ea70b62ed5a4c8f62a72cc6a"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:21.909456 23641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "cf398465aa9941b194c87bcfcd5a2723"
format_stamp: "Formatted at 2026-09-29 22:47:21 on dist-test-slave-00d6"
server_key: "cee6f2f8601aac46bf1f3f8ef1c56fb6"
server_key_iv: "e3a95162ea70b62ed5a4c8f62a72cc6a"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:21.911070 23641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:47:21.922266 23656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:21.922442 23641 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:47:21.922537 23641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "cf398465aa9941b194c87bcfcd5a2723"
format_stamp: "Formatted at 2026-09-29 22:47:21 on dist-test-slave-00d6"
server_key: "cee6f2f8601aac46bf1f3f8ef1c56fb6"
server_key_iv: "e3a95162ea70b62ed5a4c8f62a72cc6a"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:21.922637 23641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:47:21.937903 23641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:47:21.940078 23641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:47:21.940248 23641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:47:21.945096 23641 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:35629
I20260929 22:47:21.945118 23708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:35629 every 8 connection(s)
I20260929 22:47:21.945508 23641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:47:21.946143 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 23641
I20260929 22:47:21.946290 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:47:21.946319 23709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:47:21.946504 12398 external_mini_cluster.cc:1428] Setting key e4ccd8d24a30866c953515a4dbef459c
I20260929 22:47:21.950042 23709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723: Bootstrap starting.
I20260929 22:47:21.950784 23709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723: Neither blocks nor log segments found. Creating new log.
I20260929 22:47:21.951088 23709 log.cc:824] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723: Log is configured to *not* fsync() on all Append() calls
I20260929 22:47:21.952095 23709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723: No bootstrap required, opened a new log
Sep 29 22:47:21 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:47:21.954493 23709 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf398465aa9941b194c87bcfcd5a2723" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35629 } }
I20260929 22:47:21.954667 23709 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:47:21.954701 23709 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf398465aa9941b194c87bcfcd5a2723, State: Initialized, Role: FOLLOWER
I20260929 22:47:21.954876 23709 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf398465aa9941b194c87bcfcd5a2723" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35629 } }
I20260929 22:47:21.954958 23709 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:47:21.954988 23709 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:47:21.955052 23709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:47:21.955760 23709 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf398465aa9941b194c87bcfcd5a2723" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35629 } }
I20260929 22:47:21.955894 23709 leader_election.cc:302] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf398465aa9941b194c87bcfcd5a2723; no voters:
I20260929 22:47:21.956046 23709 leader_election.cc:288] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:47:21.956377 23709 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:47:21.956084 23714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:47:21.957121 23712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:21.947041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35112 (local address 127.12.27.190:35629)
0929 22:47:21.947217 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:21.947228 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:21.947320 (+ 92us) server_negotiation.cc:407] Connection header received
0929 22:47:21.947982 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:21.947990 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:21.948040 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:21.948203 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:47:21.948808 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:21.949699 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:21.950534 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:21.951022 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:21.951136 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:21.953625 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:47:21.953629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:47:21.953629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:47:21.953640 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:47:21.955385 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:21.955820 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:21.955823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:21.955823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:21.955920 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:21.956168 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:21.956168 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:21.956169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:21.956491 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:47:21.956637 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:21.956798 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 22:47:21.956913 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260929 22:47:21.957823 23714 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [term 1 LEADER]: Becoming Leader. State: Replica: cf398465aa9941b194c87bcfcd5a2723, State: Running, Role: LEADER
I20260929 22:47:21.957952 23714 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf398465aa9941b194c87bcfcd5a2723" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35629 } }
I20260929 22:47:21.958600 23709 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 22:47:21.958645 23715 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf398465aa9941b194c87bcfcd5a2723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf398465aa9941b194c87bcfcd5a2723" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35629 } } }
I20260929 22:47:21.958716 23715 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [sys.catalog]: This master's current role is: LEADER
I20260929 22:47:21.961074 23728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:47:21.959079 23726 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf398465aa9941b194c87bcfcd5a2723. Latest consensus state: current_term: 1 leader_uuid: "cf398465aa9941b194c87bcfcd5a2723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf398465aa9941b194c87bcfcd5a2723" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35629 } } }
I20260929 22:47:21.961740 23726 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723 [sys.catalog]: This master's current role is: LEADER
I20260929 22:47:21.962545 23728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:47:21.965227 23728 catalog_manager.cc:1347] Generated new cluster ID: c14cc45ec8f2407487cab7ca3cb5d57d
I20260929 22:47:21.965282 23728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:47:21.975355 23728 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:47:21.976166 23728 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:47:21.984493 23728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723: Generated new TSK 0
I20260929 22:47:21.984754 23728 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:47:22.755409 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:41997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:35629
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:47:22.880553 23754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:47:22.880851 23754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:47:22.880893 23754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:47:22.882658 23754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:47:22.882723 23754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:47:22.882766 23754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:47:22.885138 23754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.27.148:41997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:35629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:47:22.885377 23754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:47:22.885665 23754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:47:22.895301 23762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:22.895428 23760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:22.895377 23759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:47:22.896427 23754 server_base.cc:1034] running on GCE node
I20260929 22:47:22.896754 23754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:47:22.897028 23754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:47:22.898188 23754 hybrid_clock.cc:648] HybridClock initialized: now 1790722042898168 us; error 32 us; skew 500 ppm
Sep 29 22:47:22 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722042, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:47:22.902980 23754 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:47:22.903479 23754 webserver.cc:460] Webserver started at http://127.12.27.129:45311/ using document root <none> and password file <none>
I20260929 22:47:22.903733 23754 fs_manager.cc:359] Metadata directory not provided
I20260929 22:47:22.903784 23754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:47:22.903905 23754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:47:22 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722042, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:47:22.920944 23754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "919bba7c6cfe4e75ba0706780127766e"
format_stamp: "Formatted at 2026-09-29 22:47:22 on dist-test-slave-00d6"
server_key: "5586c5868be972a802e209abfc8b9075"
server_key_iv: "14f0abfa23725d259495d6accf0a7522"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:22.921555 23754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "919bba7c6cfe4e75ba0706780127766e"
format_stamp: "Formatted at 2026-09-29 22:47:22 on dist-test-slave-00d6"
server_key: "5586c5868be972a802e209abfc8b9075"
server_key_iv: "14f0abfa23725d259495d6accf0a7522"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:22.926113 23754 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260929 22:47:22.939778 23769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:22.939956 23754 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:47:22.940056 23754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "919bba7c6cfe4e75ba0706780127766e"
format_stamp: "Formatted at 2026-09-29 22:47:22 on dist-test-slave-00d6"
server_key: "5586c5868be972a802e209abfc8b9075"
server_key_iv: "14f0abfa23725d259495d6accf0a7522"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:22.940156 23754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:47:22.969188 23754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:47:22.971495 23754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:47:22.971660 23754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:47:22.971889 23754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:47:22.972218 23754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:47:22.972260 23754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:22.972294 23754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:47:22.972312 23754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:22.979017 23754 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:40257
I20260929 22:47:22.979425 23754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:47:22.980978 23884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:40257 every 8 connection(s)
I20260929 22:47:22.982436 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 23754
I20260929 22:47:22.982549 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:47:22.982758 12398 external_mini_cluster.cc:1428] Setting key 7facefaca1c3588228c82381d6a1ba5f
Sep 29 22:47:22 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722042, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:47:22.994938 23888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:22.981716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:47491 (local address 127.12.27.190:35629)
0929 22:47:22.981861 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:22.981864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:22.983203 (+ 1339us) server_negotiation.cc:407] Connection header received
0929 22:47:22.985484 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:22.985485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:22.985499 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:22.985557 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:47:22.986473 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:22.987233 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:22.988688 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:22.988978 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:22.989032 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:22.991528 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:47:22.991529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:47:22.991529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:47:22.991536 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:47:22.993413 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:22.993860 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:22.993861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:22.993862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:22.993920 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:22.994197 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:22.994197 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:22.994198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:22.994324 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:47:22.994366 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:22.994754 (+ 388us) server_negotiation.cc:299] Negotiation successful
0929 22:47:22.994836 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260929 22:47:22.995587 23887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:22.981672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:35629 (local address 127.12.27.129:47491)
0929 22:47:22.983067 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:22.983114 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:22.985356 (+ 2242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:22.985762 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:22.985767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:22.986078 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:47:22.986358 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:22.986364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:22.987346 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:22.987347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:22.988588 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:22.988591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:22.989130 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:22.989131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:22.989263 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:22.989886 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:47:22.989896 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:47:22.991426 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:47:22.993503 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:47:22.993509 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:47:22.993511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:47:22.993777 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:47:22.993989 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:47:22.993990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:47:22.993990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:47:22.994126 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:47:22.994411 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:47:22.994417 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:47:22.994607 (+ 190us) client_negotiation.cc:769] Sending connection context
0929 22:47:22.995077 (+ 470us) client_negotiation.cc:240] Negotiation successful
0929 22:47:22.995365 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1348,"thread_start_us":82,"threads_started":1}
I20260929 22:47:22.996047 23885 heartbeater.cc:347] Connected to a master server at 127.12.27.190:35629
I20260929 22:47:22.996140 23885 heartbeater.cc:464] Registering TS with master...
I20260929 22:47:22.996421 23885 heartbeater.cc:511] Master 127.12.27.190:35629 requested a full tablet report, sending...
I20260929 22:47:22.996971 23673 ts_manager.cc:194] Registered new tserver with Master: 919bba7c6cfe4e75ba0706780127766e (127.12.27.129:40257)
I20260929 22:47:22.997829 23673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:47491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:47:23.022636 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:41997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:35629
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:47:23.137590 23891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:47:23.137806 23891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:47:23.137842 23891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:47:23.139007 23891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:47:23.139071 23891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:47:23.139114 23891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:47:23.140591 23891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.27.148:41997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:35629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:47:23.140847 23891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:47:23.141076 23891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:47:23.146096 23901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:23.146095 23898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:23.146503 23899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:47:23.146927 23891 server_base.cc:1034] running on GCE node
I20260929 22:47:23.147118 23891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:47:23.147367 23891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:47:23.148576 23891 hybrid_clock.cc:648] HybridClock initialized: now 1790722043148552 us; error 52 us; skew 500 ppm
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:47:23.151098 23891 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:47:23.151563 23891 webserver.cc:460] Webserver started at http://127.12.27.130:46879/ using document root <none> and password file <none>
I20260929 22:47:23.151820 23891 fs_manager.cc:359] Metadata directory not provided
I20260929 22:47:23.151885 23891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:47:23.152027 23891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:47:23.166772 23891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "eb8b9f77dc644571bfb10de8eca6f55d"
format_stamp: "Formatted at 2026-09-29 22:47:23 on dist-test-slave-00d6"
server_key: "edfee82e570f804401e11c4427595b7c"
server_key_iv: "fb752bc19837065784905fd099e34a17"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:23.167215 23891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "eb8b9f77dc644571bfb10de8eca6f55d"
format_stamp: "Formatted at 2026-09-29 22:47:23 on dist-test-slave-00d6"
server_key: "edfee82e570f804401e11c4427595b7c"
server_key_iv: "fb752bc19837065784905fd099e34a17"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:23.173476 23891 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.001s
I20260929 22:47:23.187459 23908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:23.187674 23891 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:47:23.187770 23891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "eb8b9f77dc644571bfb10de8eca6f55d"
format_stamp: "Formatted at 2026-09-29 22:47:23 on dist-test-slave-00d6"
server_key: "edfee82e570f804401e11c4427595b7c"
server_key_iv: "fb752bc19837065784905fd099e34a17"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:23.187875 23891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:47:23.213231 23891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:47:23.215797 23891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:47:23.215956 23891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:47:23.216193 23891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:47:23.216553 23891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:47:23.216614 23891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:23.216656 23891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:47:23.216678 23891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:23.223810 23891 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:35719
I20260929 22:47:23.224246 23891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:47:23.226488 24021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:35719 every 8 connection(s)
I20260929 22:47:23.232321 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 23891
I20260929 22:47:23.232427 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:47:23.232652 12398 external_mini_cluster.cc:1428] Setting key c7d4c2047d25aa6e2bcb366e0d737156
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:47:23.240391 23888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.227293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:36947 (local address 127.12.27.190:35629)
0929 22:47:23.227346 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.227348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.227901 (+ 553us) server_negotiation.cc:407] Connection header received
0929 22:47:23.228608 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.228610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.228626 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.228657 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:47:23.229499 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.230265 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.231746 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.232058 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.232105 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.236982 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:47:23.236983 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:47:23.236983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:47:23.236991 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:47:23.238731 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:23.239240 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:23.239242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:23.239242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:23.239301 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:23.239593 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:23.239594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:23.239595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:23.239758 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:47:23.239816 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.240184 (+ 368us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.240274 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:47:23.241117 24024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.227374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:35629 (local address 127.12.27.130:36947)
0929 22:47:23.227762 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.227809 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.228474 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.228852 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.228857 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.229115 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:47:23.229394 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.229401 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.230391 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.230392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.231649 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.231652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.232956 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.232957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.233094 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.235224 (+ 2130us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:47:23.235234 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:47:23.236874 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:47:23.238826 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:47:23.238832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:47:23.238835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:47:23.239145 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:47:23.239372 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:47:23.239373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:47:23.239373 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:47:23.239502 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:47:23.239852 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:47:23.239858 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:47:23.240020 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.240725 (+ 705us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.240889 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":154,"threads_started":1}
I20260929 22:47:23.241776 24022 heartbeater.cc:347] Connected to a master server at 127.12.27.190:35629
I20260929 22:47:23.241880 24022 heartbeater.cc:464] Registering TS with master...
I20260929 22:47:23.242097 24022 heartbeater.cc:511] Master 127.12.27.190:35629 requested a full tablet report, sending...
I20260929 22:47:23.242452 23673 ts_manager.cc:194] Registered new tserver with Master: eb8b9f77dc644571bfb10de8eca6f55d (127.12.27.130:35719)
I20260929 22:47:23.242950 23673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:36947
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:47:23.266659 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:41997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:35629
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:33803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:47:23.391225 24027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:47:23.391678 24027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:47:23.391772 24027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:47:23.393507 24027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:47:23.393606 24027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:47:23.393687 24027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:47:23.395933 24027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:33803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.27.148:41997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:35629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:47:23.396212 24027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:47:23.396442 24027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:47:23.409471 24033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:23.409766 24036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:47:23.410135 24034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:47:23.411335 24027 server_base.cc:1034] running on GCE node
I20260929 22:47:23.411559 24027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:47:23.411864 24027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:47:23.415660 24027 hybrid_clock.cc:648] HybridClock initialized: now 1790722043415634 us; error 42 us; skew 500 ppm
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:47:23.419668 24027 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:47:23.420267 24027 webserver.cc:460] Webserver started at http://127.12.27.131:35197/ using document root <none> and password file <none>
I20260929 22:47:23.420614 24027 fs_manager.cc:359] Metadata directory not provided
I20260929 22:47:23.420742 24027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:47:23.420943 24027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:47:23.455272 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "8a21baf1069e45848254c52339569952"
format_stamp: "Formatted at 2026-09-29 22:47:23 on dist-test-slave-00d6"
server_key: "f37e6eb832ccf67abc864d47e5d20141"
server_key_iv: "90e4f4324b77cb95963d208487cb4eba"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:23.455777 24027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "8a21baf1069e45848254c52339569952"
format_stamp: "Formatted at 2026-09-29 22:47:23 on dist-test-slave-00d6"
server_key: "f37e6eb832ccf67abc864d47e5d20141"
server_key_iv: "90e4f4324b77cb95963d208487cb4eba"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:23.463937 24027 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.002s
I20260929 22:47:23.482935 24043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:23.483191 24027 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.000s
I20260929 22:47:23.483281 24027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "8a21baf1069e45848254c52339569952"
format_stamp: "Formatted at 2026-09-29 22:47:23 on dist-test-slave-00d6"
server_key: "f37e6eb832ccf67abc864d47e5d20141"
server_key_iv: "90e4f4324b77cb95963d208487cb4eba"
server_key_version: "kuduclusterkey@0"
I20260929 22:47:23.483381 24027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:47:23.501161 24027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:47:23.503672 24027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:47:23.503818 24027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:47:23.504007 24027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:47:23.504355 24027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:47:23.504398 24027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:23.504427 24027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:47:23.504448 24027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:47:23.513031 24027 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:45211
I20260929 22:47:23.513460 24027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:47:23.516057 24156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:45211 every 8 connection(s)
Sep 29 22:47:23 dist-test-slave-00d6 krb5kdc[23197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722043, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:47:23.523675 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 24027
I20260929 22:47:23.523780 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:47:23.523967 12398 external_mini_cluster.cc:1428] Setting key d954449218e6dc5096ac676dcff82b6b
I20260929 22:47:23.526461 23888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.514405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:58517 (local address 127.12.27.190:35629)
0929 22:47:23.514619 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.514621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.515149 (+ 528us) server_negotiation.cc:407] Connection header received
0929 22:47:23.515977 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.515978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.515993 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.516059 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:47:23.517177 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.517893 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.519392 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.519708 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.519757 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.522386 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:47:23.522387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:47:23.522387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:47:23.522396 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:47:23.524847 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:23.525350 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:23.525351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:23.525352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:23.525413 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:23.525712 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:23.525713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:23.525713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:23.525849 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:47:23.525893 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.526287 (+ 394us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.526370 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260929 22:47:23.527220 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.514375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:35629 (local address 127.12.27.131:58517)
0929 22:47:23.514962 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.515028 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.515831 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.516358 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.516363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.516638 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:47:23.517058 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.517067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.518016 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.518018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.519281 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.519283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.519851 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.519852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.519988 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.520613 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:47:23.520623 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:47:23.522272 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:47:23.524948 (+ 2676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:47:23.524954 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:47:23.524956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:47:23.525255 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:47:23.525490 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:47:23.525491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:47:23.525492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:47:23.525625 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:47:23.525942 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:47:23.525948 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:47:23.526120 (+ 172us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.526811 (+ 691us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.526973 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":93,"threads_started":1}
I20260929 22:47:23.527977 24157 heartbeater.cc:347] Connected to a master server at 127.12.27.190:35629
I20260929 22:47:23.528079 24157 heartbeater.cc:464] Registering TS with master...
I20260929 22:47:23.528256 24157 heartbeater.cc:511] Master 127.12.27.190:35629 requested a full tablet report, sending...
I20260929 22:47:23.528859 23672 ts_manager.cc:194] Registered new tserver with Master: 8a21baf1069e45848254c52339569952 (127.12.27.131:45211)
I20260929 22:47:23.529356 23672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:58517
I20260929 22:47:23.539521 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:47:23.560412 23888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.544767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35116 (local address 127.12.27.190:35629)
0929 22:47:23.544841 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.544843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.545189 (+ 346us) server_negotiation.cc:407] Connection header received
0929 22:47:23.545291 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.545292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.545303 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.545332 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:47:23.546164 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.546916 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.548075 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.548413 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.548491 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.553023 (+ 4532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:47:23.553025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:47:23.553025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:47:23.553034 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:47:23.554764 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:23.559466 (+ 4702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:23.559467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:23.559467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:23.559528 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:47:23.559764 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:47:23.559765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:47:23.559766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:47:23.559899 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:47:23.559997 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.560229 (+ 232us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.560314 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 22:47:23.562952 23672 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:47:23.565253 23672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:47:23.582659 24173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.569496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:45211 (local address 127.0.0.1:32864)
0929 22:47:23.570942 (+ 1446us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.570983 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.571046 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.571588 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.571591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.571594 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:47:23.571695 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.571697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.578395 (+ 6698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.578396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.579365 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.579368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.582323 (+ 2955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.582324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.582413 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.582428 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.582505 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.582560 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1414,"thread_start_us":66,"threads_started":1}
I20260929 22:47:23.585721 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.570365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:40257 (local address 127.0.0.1:51234)
0929 22:47:23.573140 (+ 2775us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.573149 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.573190 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.573442 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.573443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.573445 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:47:23.573487 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.573489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.576595 (+ 3106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.576596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.583223 (+ 6627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.583225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.585455 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.585456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.585534 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.585539 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.585596 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.585638 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2761,"thread_start_us":63,"threads_started":1}
I20260929 22:47:23.586158 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.570634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.12.27.129:40257)
0929 22:47:23.571173 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.571178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.573258 (+ 2080us) server_negotiation.cc:407] Connection header received
0929 22:47:23.573296 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.573298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.573315 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.573380 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:47:23.573555 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.574663 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.583344 (+ 8681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.584164 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.584238 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.584311 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.586026 (+ 1715us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.586077 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":67,"threads_started":1}
I20260929 22:47:23.587809 23819 tablet_service.cc:1467] Processing CreateTablet for tablet 1e8a5e7b45154458826df6e711f34319 (DEFAULT_TABLE table=test-table [id=a3e1a5615b464c37bf0544ac9d5af646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:47:23.588222 23819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e8a5e7b45154458826df6e711f34319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:47:23.587009 24169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.569743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:35719 (local address 127.0.0.1:47976)
0929 22:47:23.572807 (+ 3064us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.572817 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.572861 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.575038 (+ 2177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.575039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.575041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:47:23.575081 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.575083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.577271 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.577272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.580359 (+ 3087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.580362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.586758 (+ 6396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.586759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.586822 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.586826 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.586900 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.586941 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3047,"thread_start_us":73,"threads_started":1}
I20260929 22:47:23.593447 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.569954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47976 (local address 127.12.27.130:35719)
0929 22:47:23.571269 (+ 1315us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.571272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.572919 (+ 1647us) server_negotiation.cc:407] Connection header received
0929 22:47:23.572962 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.572964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.572979 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.573043 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:47:23.575169 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.576490 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.584375 (+ 7885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.586574 (+ 2199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.586649 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.586721 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.593310 (+ 6589us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.593365 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1269,"thread_start_us":70,"threads_started":1}
I20260929 22:47:23.593668 24172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.570106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32864 (local address 127.12.27.131:45211)
0929 22:47:23.571348 (+ 1242us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.571351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.571362 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:47:23.571402 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.571404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.571421 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.571497 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:47:23.571786 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.578291 (+ 6505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.581270 (+ 2979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.582108 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.582186 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.582284 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.593092 (+ 10808us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.593154 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1209,"thread_start_us":75,"threads_started":1}
I20260929 22:47:23.594398 24175 tablet_bootstrap.cc:492] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e: Bootstrap starting.
I20260929 22:47:23.594470 24087 tablet_service.cc:1467] Processing CreateTablet for tablet 1e8a5e7b45154458826df6e711f34319 (DEFAULT_TABLE table=test-table [id=a3e1a5615b464c37bf0544ac9d5af646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:47:23.594851 24087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e8a5e7b45154458826df6e711f34319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:47:23.595367 24175 tablet_bootstrap.cc:654] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e: Neither blocks nor log segments found. Creating new log.
I20260929 22:47:23.595762 24175 log.cc:824] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:47:23.596642 24175 tablet_bootstrap.cc:492] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e: No bootstrap required, opened a new log
I20260929 22:47:23.596710 24175 ts_tablet_manager.cc:1397] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:47:23.599059 23955 tablet_service.cc:1467] Processing CreateTablet for tablet 1e8a5e7b45154458826df6e711f34319 (DEFAULT_TABLE table=test-table [id=a3e1a5615b464c37bf0544ac9d5af646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:47:23.599395 23955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e8a5e7b45154458826df6e711f34319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:47:23.599411 24175 raft_consensus.cc:348] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.599562 24175 raft_consensus.cc:374] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:47:23.599593 24175 raft_consensus.cc:729] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 919bba7c6cfe4e75ba0706780127766e, State: Initialized, Role: FOLLOWER
I20260929 22:47:23.600294 24175 consensus_queue.cc:260] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.600678 24175 ts_tablet_manager.cc:1428] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260929 22:47:23.600845 23885 heartbeater.cc:503] Master 127.12.27.190:35629 was elected leader, sending a full tablet report...
I20260929 22:47:23.603071 24179 tablet_bootstrap.cc:492] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Bootstrap starting.
I20260929 22:47:23.604449 24179 tablet_bootstrap.cc:654] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Neither blocks nor log segments found. Creating new log.
I20260929 22:47:23.604921 24179 log.cc:824] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:47:23.605712 24179 tablet_bootstrap.cc:492] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: No bootstrap required, opened a new log
I20260929 22:47:23.605798 24179 ts_tablet_manager.cc:1397] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260929 22:47:23.607764 24179 raft_consensus.cc:348] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.607933 24179 raft_consensus.cc:374] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:47:23.607972 24179 raft_consensus.cc:729] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8b9f77dc644571bfb10de8eca6f55d, State: Initialized, Role: FOLLOWER
I20260929 22:47:23.608085 24179 consensus_queue.cc:260] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.608361 24179 ts_tablet_manager.cc:1428] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:47:23.608952 24022 heartbeater.cc:503] Master 127.12.27.190:35629 was elected leader, sending a full tablet report...
I20260929 22:47:23.610194 24182 raft_consensus.cc:482] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:47:23.610358 24182 raft_consensus.cc:504] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.611827 24177 tablet_bootstrap.cc:492] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Bootstrap starting.
I20260929 22:47:23.612000 24182 leader_election.cc:288] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a21baf1069e45848254c52339569952 (127.12.27.131:45211), eb8b9f77dc644571bfb10de8eca6f55d (127.12.27.130:35719)
I20260929 22:47:23.613022 24177 tablet_bootstrap.cc:654] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Neither blocks nor log segments found. Creating new log.
I20260929 22:47:23.613340 24177 log.cc:824] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Log is configured to *not* fsync() on all Append() calls
I20260929 22:47:23.618633 24172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.611069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:51083 (local address 127.12.27.131:45211)
0929 22:47:23.611113 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.611115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.612254 (+ 1139us) server_negotiation.cc:407] Connection header received
0929 22:47:23.612370 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.612371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.612386 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.612421 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:47:23.613119 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.613864 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.617673 (+ 3809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.618228 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.618277 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.618285 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.618502 (+ 217us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.618553 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:47:23.619068 24177 tablet_bootstrap.cc:492] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: No bootstrap required, opened a new log
I20260929 22:47:23.619139 24177 ts_tablet_manager.cc:1397] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260929 22:47:23.619851 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.610881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:45211 (local address 127.12.27.129:51083)
0929 22:47:23.612169 (+ 1288us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.612182 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.612284 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.612519 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.612520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.612522 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:47:23.612611 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.612613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.614046 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.614046 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.615216 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.615219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.618345 (+ 3126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.618346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.618415 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.618419 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.619314 (+ 895us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.619361 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":73,"threads_started":1}
I20260929 22:47:23.621007 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.611908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:53523 (local address 127.12.27.130:35719)
0929 22:47:23.611968 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.611970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.612746 (+ 776us) server_negotiation.cc:407] Connection header received
0929 22:47:23.612834 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.612835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.612843 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.612871 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:47:23.615346 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.616129 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.620089 (+ 3960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.620627 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.620675 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.620683 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.620909 (+ 226us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.620950 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:47:23.621644 24105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e8a5e7b45154458826df6e711f34319" candidate_uuid: "919bba7c6cfe4e75ba0706780127766e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a21baf1069e45848254c52339569952" is_pre_election: true
I20260929 22:47:23.621757 24177 raft_consensus.cc:348] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.621855 24177 raft_consensus.cc:374] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:47:23.621886 24177 raft_consensus.cc:729] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a21baf1069e45848254c52339569952, State: Initialized, Role: FOLLOWER
I20260929 22:47:23.622021 24177 consensus_queue.cc:260] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.621376 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.611749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:35719 (local address 127.12.27.129:53523)
0929 22:47:23.612698 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.612707 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:47:23.612770 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:47:23.612930 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:47:23.612931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:47:23.612932 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:47:23.613009 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.613010 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.616265 (+ 3255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.616266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.617539 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:47:23.617542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.620753 (+ 3211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.620754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:47:23.620824 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.620828 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:47:23.621247 (+ 419us) client_negotiation.cc:240] Negotiation successful
0929 22:47:23.621289 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"thread_start_us":69,"threads_started":1}
I20260929 22:47:23.622265 24105 raft_consensus.cc:2454] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 919bba7c6cfe4e75ba0706780127766e in term 0.
I20260929 22:47:23.622299 24177 ts_tablet_manager.cc:1428] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:47:23.622399 24157 heartbeater.cc:503] Master 127.12.27.190:35629 was elected leader, sending a full tablet report...
I20260929 22:47:23.622494 23772 leader_election.cc:302] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a21baf1069e45848254c52339569952, 919bba7c6cfe4e75ba0706780127766e; no voters:
I20260929 22:47:23.622967 23976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e8a5e7b45154458826df6e711f34319" candidate_uuid: "919bba7c6cfe4e75ba0706780127766e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" is_pre_election: true
I20260929 22:47:23.623111 23976 raft_consensus.cc:2454] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 919bba7c6cfe4e75ba0706780127766e in term 0.
I20260929 22:47:23.623037 24178 raft_consensus.cc:2781] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:47:23.623240 24178 raft_consensus.cc:482] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:47:23.623315 24178 raft_consensus.cc:3037] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:47:23.624301 24178 raft_consensus.cc:504] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.624534 24178 leader_election.cc:288] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [CANDIDATE]: Term 1 election: Requested vote from peers 8a21baf1069e45848254c52339569952 (127.12.27.131:45211), eb8b9f77dc644571bfb10de8eca6f55d (127.12.27.130:35719)
I20260929 22:47:23.624676 24105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e8a5e7b45154458826df6e711f34319" candidate_uuid: "919bba7c6cfe4e75ba0706780127766e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a21baf1069e45848254c52339569952"
I20260929 22:47:23.624745 24105 raft_consensus.cc:3037] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:47:23.625527 24105 raft_consensus.cc:2454] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 919bba7c6cfe4e75ba0706780127766e in term 1.
I20260929 22:47:23.625790 23772 leader_election.cc:302] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a21baf1069e45848254c52339569952, 919bba7c6cfe4e75ba0706780127766e; no voters:
I20260929 22:47:23.625917 23976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e8a5e7b45154458826df6e711f34319" candidate_uuid: "919bba7c6cfe4e75ba0706780127766e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb8b9f77dc644571bfb10de8eca6f55d"
I20260929 22:47:23.625989 23976 raft_consensus.cc:3037] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:47:23.626883 23976 raft_consensus.cc:2454] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 919bba7c6cfe4e75ba0706780127766e in term 1.
I20260929 22:47:23.627434 24178 raft_consensus.cc:2781] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:47:23.627722 24178 raft_consensus.cc:686] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [term 1 LEADER]: Becoming Leader. State: Replica: 919bba7c6cfe4e75ba0706780127766e, State: Running, Role: LEADER
I20260929 22:47:23.628011 24178 consensus_queue.cc:237] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } }
I20260929 22:47:23.628890 23672 catalog_manager.cc:5495] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e reported cstate change: term changed from 0 to 1, leader changed from <none> to 919bba7c6cfe4e75ba0706780127766e (127.12.27.129). New cstate: current_term: 1 leader_uuid: "919bba7c6cfe4e75ba0706780127766e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "919bba7c6cfe4e75ba0706780127766e" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 40257 } health_report { overall_health: HEALTHY } } }
I20260929 22:47:23.640077 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.636575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51242 (local address 127.12.27.129:40257)
0929 22:47:23.636743 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 22:47:23.636745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:47:23.636752 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:47:23.636782 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:47:23.636783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:47:23.636801 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:47:23.636860 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:47:23.637035 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.637786 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.638907 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:47:23.639199 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:47:23.639275 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:47:23.639469 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:47:23.639617 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:47:23.639715 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 22:47:23.639979 (+ 264us) server_negotiation.cc:299] Negotiation successful
0929 22:47:23.640001 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260929 22:47:23.648826 23976 raft_consensus.cc:1261] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 1 FOLLOWER]: Refusing update from remote peer 919bba7c6cfe4e75ba0706780127766e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:47:23.649317 24178 consensus_queue.cc:1035] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb8b9f77dc644571bfb10de8eca6f55d" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:47:23.652411 24105 raft_consensus.cc:1261] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 1 FOLLOWER]: Refusing update from remote peer 919bba7c6cfe4e75ba0706780127766e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:47:23.652805 24178 consensus_queue.cc:1035] T 1e8a5e7b45154458826df6e711f34319 P 919bba7c6cfe4e75ba0706780127766e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a21baf1069e45848254c52339569952" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:47:23.658638 24189 mvcc.cc:205] Tried to move back new op lower bound from 7334797490782232576 to 7334797490701221888. Current Snapshot: MvccSnapshot[applied={T|T < 7334797490782232576}]
I20260929 22:47:23.658804 24190 mvcc.cc:205] Tried to move back new op lower bound from 7334797490782232576 to 7334797490701221888. Current Snapshot: MvccSnapshot[applied={T|T < 7334797490782232576}]
I20260929 22:47:23.659403 24192 mvcc.cc:205] Tried to move back new op lower bound from 7334797490782232576 to 7334797490701221888. Current Snapshot: MvccSnapshot[applied={T|T < 7334797490782232576}]
I20260929 22:47:23.661868 23672 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:47:23.661960 23672 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:47:23.663079 23672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf398465aa9941b194c87bcfcd5a2723: Sending DeleteTablet for 3 replicas of tablet 1e8a5e7b45154458826df6e711f34319
I20260929 22:47:23.663396 24087 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e8a5e7b45154458826df6e711f34319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:47:23 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:32864
I20260929 22:47:23.664029 23955 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e8a5e7b45154458826df6e711f34319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:47:23 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:47976
I20260929 22:47:23.664350 23819 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e8a5e7b45154458826df6e711f34319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:47:23 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:51234
I20260929 22:47:23.664886 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 23754
I20260929 22:47:23.669144 24199 tablet_replica.cc:330] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: stopping tablet replica
I20260929 22:47:23.669293 24199 raft_consensus.cc:2229] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:47:23.669454 24199 raft_consensus.cc:2258] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:47:23.669929 24199 ts_tablet_manager.cc:1905] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:47:23.670071 24198 tablet_replica.cc:330] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: stopping tablet replica
I20260929 22:47:23.672125 24198 raft_consensus.cc:2229] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:47:23.672324 24198 raft_consensus.cc:2258] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:47:23.672827 24198 ts_tablet_manager.cc:1905] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:47:23.674356 24199 ts_tablet_manager.cc:1918] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:47:23.674484 24199 log.cc:1196] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/1e8a5e7b45154458826df6e711f34319
I20260929 22:47:23.674624 24198 ts_tablet_manager.cc:1918] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:47:23.674733 24198 log.cc:1196] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/1e8a5e7b45154458826df6e711f34319
I20260929 22:47:23.675361 24199 ts_tablet_manager.cc:1939] T 1e8a5e7b45154458826df6e711f34319 P eb8b9f77dc644571bfb10de8eca6f55d: Deleting consensus metadata
I20260929 22:47:23.676012 24198 ts_tablet_manager.cc:1939] T 1e8a5e7b45154458826df6e711f34319 P 8a21baf1069e45848254c52339569952: Deleting consensus metadata
I20260929 22:47:23.676492 23658 catalog_manager.cc:4841] TS eb8b9f77dc644571bfb10de8eca6f55d (127.12.27.130:35719): tablet 1e8a5e7b45154458826df6e711f34319 (table test-table [id=a3e1a5615b464c37bf0544ac9d5af646]) successfully deleted
I20260929 22:47:23.676990 23659 catalog_manager.cc:4841] TS 8a21baf1069e45848254c52339569952 (127.12.27.131:45211): tablet 1e8a5e7b45154458826df6e711f34319 (table test-table [id=a3e1a5615b464c37bf0544ac9d5af646]) successfully deleted
W20260929 22:47:23.679126 23657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:40257 (error 108)
I20260929 22:47:23.679774 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:47:23.679655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:40257 (local address 127.0.0.1:51246)
0929 22:47:23.679693 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 22:47:23.679741 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:40257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260929 22:47:23.679879 23657 catalog_manager.cc:4584] TS 919bba7c6cfe4e75ba0706780127766e (127.12.27.129:40257): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1e8a5e7b45154458826df6e711f34319: Network error: Client connection negotiation failed: client connection to 127.12.27.129:40257: connect: Connection refused (error 111)
I20260929 22:47:23.683770 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 23891
I20260929 22:47:23.690765 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 24027
I20260929 22:47:23.698180 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 23641
I20260929 22:47:23.705040 12398 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 22:47:24.049503 12398 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 22:47:24.049610 12398 mini_ranger.cc:66] Stopping Ranger...
I20260929 22:47:24.393975 12398 mini_ranger.cc:68] Stopped Ranger
2026-09-29 22:47:24.394 UTC [23227] LOG: received smart shutdown request
2026-09-29 22:47:24.398 UTC [23227] LOG: background worker "logical replication launcher" (PID 23236) exited with exit code 1
2026-09-29 22:47:24.399 UTC [23231] LOG: shutting down
2026-09-29 22:47:24.573 UTC [23227] LOG: database system is shut down
2026-09-29T22:47:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46760 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:47:24 dist-test-slave-00d6 krb5kdc[24210](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:47:24 dist-test-slave-00d6 krb5kdc[24210](info): set up 2 sockets
Sep 29 22:47:24 dist-test-slave-00d6 krb5kdc[24210](info): commencing operation
krb5kdc: starting...
W20260929 22:47:25.720067 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:47:25 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:47:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/rangeradmin_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/rangeradmin_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/rangerlookup_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/rangerlookup_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
I20260929 22:47:25.886879 12398 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskh9tbJl/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/postgres -l logfile start
2026-09-29 22:47:28.413 UTC [24240] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 22:47:28.413 UTC [24240] LOG: listening on IPv4 address "127.12.27.148", port 58233
2026-09-29 22:47:28.417 UTC [24240] LOG: listening on Unix socket "/tmp/.s.PGSQL.58233"
2026-09-29 22:47:28.438 UTC [24243] LOG: database system was shut down at 2026-09-29 22:47:26 UTC
2026-09-29 22:47:28.441 UTC [24240] LOG: database system is ready to accept connections
I20260929 22:47:29.400478 12398 mini_postgres.cc:96] Postgres bound to 58233
2026-09-29 22:47:29.406 UTC [24251] FATAL: database "slave" does not exist
127.12.27.148:58233 - accepting connections
I20260929 22:47:29.407274 12398 mini_ranger.cc:161] Starting Ranger...
I20260929 22:47:29.423787 12398 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 22:47:29.924906 12398 mini_ranger.cc:87] Created ranger Postgres database
I20260929 22:47:29.924989 12398 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-admin
2026-09-29 22:47:30,189 [I] DB FLAVOR :POSTGRES
2026-09-29 22:47:30,189 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:47:30,189 [I] Checking connection..
2026-09-29 22:47:30,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 22:47:30,426 [I] Checking connection passed.
2026-09-29 22:47:30,426 [I] --------- Verifying version history table ---------
2026-09-29 22:47:30,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:47:30,690 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:47:30,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:47:30,926 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 22:47:30,926 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 22:47:30,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 22:47:31.183 UTC [24315] WARNING: there is no transaction in progress
2026-09-29 22:47:31,189 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 22:47:31,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 22:47:31,451 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 22:47:31,451 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:47:31,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 22:47:31,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 22:47:31,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-00d6.c.gcp-upstream.internal','N') ;"
2026-09-29 22:47:32,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:47:32,472 [I] Table x_portal_user does not exist in database ranger
2026-09-29 22:47:32,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:47:32,736 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 22:47:32,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:47:32,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:47:33,206 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 22:47:33,206 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 22:47:34.165 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.181 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.198 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.214 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.231 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.249 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.306 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.312 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.326 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.337 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.347 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.361 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.371 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.378 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.385 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:34.392 UTC [24423] WARNING: there is no transaction in progress
2026-09-29 22:47:35,060 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 22:47:35,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 22:47:35,283 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 22:47:35,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 22:47:35,526 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 22:47:35,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 22:47:35,755 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 22:47:35,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 22:47:36,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 22:47:36,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-00d6.c.gcp-upstream.internal';"
2026-09-29 22:47:36,491 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 22:47:36,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 22:47:36,736 [I] DB_PATCHES have already been applied
I20260929 22:47:36.741483 12398 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-admin:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskh9tbJl/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 22:47:36.741569 12398 mini_ranger.cc:193] Using host: 127.12.27.148
I20260929 22:47:36.744499 12398 mini_ranger.cc:227] Ranger admin URL: http://127.12.27.148:48199
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 10:47:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 22:47:37.842338 12398 mini_ranger.cc:160] Time spent starting Ranger: real 8.435s user 0.003s sys 0.005s
Sep 29, 2026 10:47:57 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 10:47:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Sep 29, 2026 10:47:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 10:47:57 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 10:47:58 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 22:47:58.691497 12398 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.27.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.27.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/rangerkms_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.27.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/rangerkms_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.27.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.27.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.27.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/HTTP_127.12.27.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 22:47:58 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722078, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 22:47:58.778695 12398 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 22:47:58.787962 12398 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 22:47:59.724118 12398 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 22:47:59.724216 12398 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms
I20260929 22:47:59.724241 12398 mini_ranger_kms.cc:227] Using postgres at 127.12.27.148:58233
2026-09-29 22:47:59,886 [I] DB FLAVOR :POSTGRES
2026-09-29 22:47:59,886 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 22:47:59,887 [I] Checking connection
2026-09-29 22:47:59,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 22:48:00,128 [I] connection success
2026-09-29 22:48:00,128 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 22:48:00,128 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 22:48:00,128 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 22:48:00,357 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 22:48:00,358 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 22:48:00,358 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 22:48:00,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.27.148:58233/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 22:48:00,651 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 22:48:01.104840 12398 mini_ranger_kms.cc:310] Created kms service
I20260929 22:48:01.330189 12398 mini_ranger_kms.cc:326] Created kudu user
I20260929 22:48:01.377022 12398 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 22:48:01 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722078, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:01.779783 12398 mini_ranger_kms.cc:384] Added ranger policy
I20260929 22:48:01.779896 12398 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms:/tmp/dist-test-taskh9tbJl/build/release/bin/postgresql.jar:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskh9tbJl/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 22:48:01.779914 12398 mini_ranger_kms.cc:240] Using host: 127.12.27.148
I20260929 22:48:01.783185 12398 mini_ranger_kms.cc:276] Ranger KMS PID: 24603
I20260929 22:48:01.783270 12398 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.27.148:47481
Sep 29, 2026 10:48:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 10:48:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 10:48:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 10:48:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 10:48:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 10:48:03 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Sep 29 22:48:03 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722083, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.27.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:04.032660 12398 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.254s user 0.006s sys 0.139s
I20260929 22:48:04.032756 12398 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 22:48:04.032811 12398 mini_ranger_kms.cc:401] 127.12.27.148:47481/kms/v1/keys
Sep 29 22:48:04 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722083, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.27.148@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
Sep 29 22:48:04 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722083, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.27.148@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
Sep 29 22:48:06 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:48:06.910588 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46587
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:46587
--ranger_config_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:06.991647 24654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:06.991858 24654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:06.991880 24654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:06.993114 24654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:06.993161 24654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:06.993176 24654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:06.993191 24654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:06.993203 24654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:06.994825 24654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.27.148:47481/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:46587
--ranger_config_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:06.995072 24654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:06.995349 24654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:48:07.000789 24654 server_base.cc:1034] running on GCE node
W20260929 22:48:07.000967 24662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:07.001106 24659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:07.000792 24660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:07.001389 24654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:07.001745 24654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:07.002934 24654 hybrid_clock.cc:648] HybridClock initialized: now 1790722087002908 us; error 36 us; skew 500 ppm
Sep 29 22:48:07 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722087, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:07.016403 24654 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:07.017030 24654 webserver.cc:460] Webserver started at http://127.12.27.190:41529/ using document root <none> and password file <none>
I20260929 22:48:07.017285 24654 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:07.017328 24654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:07.017480 24654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:48:07 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722087, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:07.070045 24654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "233c322f0b0e446e940d74d77e45450c"
format_stamp: "Formatted at 2026-09-29 22:48:07 on dist-test-slave-00d6"
server_key: "20399866256e8a6a19f10f581691a26e"
server_key_iv: "dc47433a462bb103f92187e40078cd07"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:07.070456 24654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "233c322f0b0e446e940d74d77e45450c"
format_stamp: "Formatted at 2026-09-29 22:48:07 on dist-test-slave-00d6"
server_key: "20399866256e8a6a19f10f581691a26e"
server_key_iv: "dc47433a462bb103f92187e40078cd07"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:07.071950 24654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:48:07.083171 24669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:07.083374 24654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:07.083495 24654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "233c322f0b0e446e940d74d77e45450c"
format_stamp: "Formatted at 2026-09-29 22:48:07 on dist-test-slave-00d6"
server_key: "20399866256e8a6a19f10f581691a26e"
server_key_iv: "dc47433a462bb103f92187e40078cd07"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:07.083609 24654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:07.093606 24654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:07.095728 24654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:07.095887 24654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:07.100278 24654 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:46587
I20260929 22:48:07.100317 24721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:46587 every 8 connection(s)
I20260929 22:48:07.100690 24654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:07.101432 24722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:07.104563 24722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Bootstrap starting.
I20260929 22:48:07.105284 24722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:07.105609 24722 log.cc:824] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:07.106433 24722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: No bootstrap required, opened a new log
I20260929 22:48:07.106858 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 24654
I20260929 22:48:07.106980 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:48:07.107159 12398 external_mini_cluster.cc:1428] Setting key 0a13b24c0f44a04033db25723cbb8844
I20260929 22:48:07.109504 24722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:07.109745 24722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:07.109858 24722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233c322f0b0e446e940d74d77e45450c, State: Initialized, Role: FOLLOWER
I20260929 22:48:07.110051 24722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:07.110134 24722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:07.110164 24722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:07.110234 24722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:07.111012 24722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:07.111121 24722 leader_election.cc:302] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 233c322f0b0e446e940d74d77e45450c; no voters:
I20260929 22:48:07.111320 24722 leader_election.cc:288] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:48:07.111375 24727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:07.111605 24727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 LEADER]: Becoming Leader. State: Replica: 233c322f0b0e446e940d74d77e45450c, State: Running, Role: LEADER
I20260929 22:48:07.111671 24722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:07.112401 24727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:07.113189 24728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "233c322f0b0e446e940d74d77e45450c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } } }
I20260929 22:48:07.113204 24722 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 22:48:07.113296 24728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:07.113595 24729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233c322f0b0e446e940d74d77e45450c. Latest consensus state: current_term: 1 leader_uuid: "233c322f0b0e446e940d74d77e45450c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } } }
I20260929 22:48:07.113672 24729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:07.113794 24741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:07.114279 24741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 22:48:07 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:07.120010 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:07.107822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57172 (local address 127.12.27.190:46587)
0929 22:48:07.108019 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:07.108029 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:07.108062 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:48:07.109504 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:07.109512 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:07.109567 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:07.109823 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:07.110599 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:07.111929 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:07.113229 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:07.113858 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:07.113998 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:07.116653 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:07.116657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:07.116658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:07.116669 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:07.118309 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:07.118700 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:07.118703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:07.118704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:07.118799 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:07.119021 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:07.119022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:07.119022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:07.119256 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:07.119411 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:07.119511 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 22:48:07.119653 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":120,"threads_started":1}
I20260929 22:48:07.127244 24741 catalog_manager.cc:1347] Generated new cluster ID: d5c57735252e4dcc94871570b08de27a
I20260929 22:48:07.127400 24741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:48:07.144824 24741 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:48:07.145663 24741 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:07.158120 24741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Generated new TSK 0
I20260929 22:48:07.158418 24741 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:48:07.930698 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:46587
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:08.041385 24767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:08.041720 24767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:08.041780 24767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:08.043447 24767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:08.043501 24767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:08.043540 24767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:08.045703 24767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.27.148:47481/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:08.046060 24767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:08.046329 24767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:08.052591 24775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:08.052603 24774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:08.052914 24767 server_base.cc:1034] running on GCE node
W20260929 22:48:08.052661 24777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:08.053956 24767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:08.054246 24767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:08.055433 24767 hybrid_clock.cc:648] HybridClock initialized: now 1790722088055402 us; error 43 us; skew 500 ppm
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:08.058792 24767 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:08.059294 24767 webserver.cc:460] Webserver started at http://127.12.27.129:45583/ using document root <none> and password file <none>
I20260929 22:48:08.059588 24767 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:08.059679 24767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:08.059803 24767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:08.076181 24767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "8812459fd2004690a57b26d817d17553"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "c04c5b9e3ca80f6503483b0eb0e6a988"
server_key_iv: "29fc1bef143fc8d630caf04088888ac0"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.076622 24767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "8812459fd2004690a57b26d817d17553"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "c04c5b9e3ca80f6503483b0eb0e6a988"
server_key_iv: "29fc1bef143fc8d630caf04088888ac0"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.078874 24767 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260929 22:48:08.096473 24784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.096704 24767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260929 22:48:08.096808 24767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "8812459fd2004690a57b26d817d17553"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "c04c5b9e3ca80f6503483b0eb0e6a988"
server_key_iv: "29fc1bef143fc8d630caf04088888ac0"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.096902 24767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:08.122265 24767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:08.124780 24767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:08.124977 24767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:08.125260 24767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:08.125731 24767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:08.125819 24767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.125923 24767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:08.125993 24767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.133271 24767 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:33443
I20260929 22:48:08.133769 24767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:08.135573 24897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:33443 every 8 connection(s)
I20260929 22:48:08.137351 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 24767
I20260929 22:48:08.137447 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:48:08.137666 12398 external_mini_cluster.cc:1428] Setting key ea6671b41682254f296211249acc83a2
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:08.147452 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:08.136279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:46587 (local address 127.12.27.129:52619)
0929 22:48:08.136484 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:08.136536 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:08.137170 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:08.137822 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:08.137827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:08.138071 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:08.138336 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:08.138341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.139358 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.139359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:08.140733 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:08.140737 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.141287 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.141288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:08.141445 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:08.142022 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:08.142033 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:08.143746 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:08.145810 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:08.145818 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:08.145820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:08.146118 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:08.146336 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:08.146337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:08.146337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:08.146479 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:08.146772 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:08.146778 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:08.146939 (+ 161us) client_negotiation.cc:769] Sending connection context
0929 22:48:08.147046 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 22:48:08.147201 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":102,"threads_started":1}
I20260929 22:48:08.148149 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:08.136308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:52619 (local address 127.12.27.190:46587)
0929 22:48:08.137392 (+ 1084us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:08.137395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:08.137461 (+ 66us) server_negotiation.cc:407] Connection header received
0929 22:48:08.137538 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:08.137539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:08.137554 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:08.137627 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:08.138468 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.139256 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.140832 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.141130 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.141200 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:08.143861 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:08.143863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:08.143863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:08.143871 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:08.145717 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:08.146206 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:08.146207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:08.146208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:08.146271 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:08.146551 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:08.146552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:08.146552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:08.146689 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:08.146748 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:08.147841 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0929 22:48:08.148044 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1036,"thread_start_us":112,"threads_started":1}
I20260929 22:48:08.149080 24898 heartbeater.cc:347] Connected to a master server at 127.12.27.190:46587
I20260929 22:48:08.149176 24898 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:08.149380 24898 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:08.150118 24686 ts_manager.cc:194] Registered new tserver with Master: 8812459fd2004690a57b26d817d17553 (127.12.27.129:33443)
I20260929 22:48:08.151278 24686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:52619
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:48:08.179042 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:46587
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260929 22:48:08.297108 24906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:08.297395 24906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:08.297437 24906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:08.299108 24906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:08.299173 24906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:08.299218 24906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:08.301366 24906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.27.148:47481/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:08.301613 24906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:08.301941 24906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:08.308060 24912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:08.308079 24911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:08.308279 24914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:08.309367 24906 server_base.cc:1034] running on GCE node
I20260929 22:48:08.309589 24906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:08.309926 24906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:08.313215 24906 hybrid_clock.cc:648] HybridClock initialized: now 1790722088313180 us; error 44 us; skew 500 ppm
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:08.316515 24906 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:08.317015 24906 webserver.cc:460] Webserver started at http://127.12.27.130:46151/ using document root <none> and password file <none>
I20260929 22:48:08.317332 24906 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:08.317401 24906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:08.317533 24906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:08.332497 24906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "abc5248241cf4c95a9094d127e325509"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "e0794bb34177966e20b7c9fe5088c514"
server_key_iv: "a0cfdc297a4f355c408035a0c7ae4f39"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.333024 24906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "abc5248241cf4c95a9094d127e325509"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "e0794bb34177966e20b7c9fe5088c514"
server_key_iv: "a0cfdc297a4f355c408035a0c7ae4f39"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.334712 24906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:08.346648 24922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.346876 24906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:48:08.346972 24906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "abc5248241cf4c95a9094d127e325509"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "e0794bb34177966e20b7c9fe5088c514"
server_key_iv: "a0cfdc297a4f355c408035a0c7ae4f39"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.347049 24906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:08.371443 24906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:08.373929 24906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:08.374122 24906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:08.374408 24906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:08.374815 24906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:08.374907 24906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.374972 24906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:08.375017 24906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.381844 24906 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:44511
I20260929 22:48:08.382342 24906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:48:08.383904 25035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:44511 every 8 connection(s)
I20260929 22:48:08.388091 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 24906
I20260929 22:48:08.388201 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:48:08.388429 12398 external_mini_cluster.cc:1428] Setting key ca5361996b5dbc440a9de3d47aa2ef3e
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:08.398944 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:08.384869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:56583 (local address 127.12.27.190:46587)
0929 22:48:08.384933 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:08.384935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:08.387926 (+ 2991us) server_negotiation.cc:407] Connection header received
0929 22:48:08.389438 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:08.389440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:08.389454 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:08.389483 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:08.390319 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.391068 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.392601 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.392939 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.392989 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:08.395586 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:08.395588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:08.395588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:08.395595 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:08.397287 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:08.397778 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:08.397780 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:08.397780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:08.397853 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:08.398229 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:08.398230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:08.398230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:08.398357 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:08.398397 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:08.398745 (+ 348us) server_negotiation.cc:299] Negotiation successful
0929 22:48:08.398831 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:48:08.399749 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:08.384565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:46587 (local address 127.12.27.130:56583)
0929 22:48:08.387738 (+ 3173us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:08.387787 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:08.389329 (+ 1542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:08.389666 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:08.389670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:08.389926 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:08.390196 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:08.390203 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.391182 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.391183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:08.392497 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:08.392500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.393094 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.393095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:08.393241 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:08.393861 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:08.393872 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:08.395481 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:08.397379 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:08.397386 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:08.397388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:08.397687 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:08.398025 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:08.398026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:08.398026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:08.398156 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:08.398443 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:08.398448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:08.398600 (+ 152us) client_negotiation.cc:769] Sending connection context
0929 22:48:08.399342 (+ 742us) client_negotiation.cc:240] Negotiation successful
0929 22:48:08.399500 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3126,"thread_start_us":100,"threads_started":1}
I20260929 22:48:08.400393 25036 heartbeater.cc:347] Connected to a master server at 127.12.27.190:46587
I20260929 22:48:08.400483 25036 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:08.400661 25036 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:08.401075 24686 ts_manager.cc:194] Registered new tserver with Master: abc5248241cf4c95a9094d127e325509 (127.12.27.130:44511)
I20260929 22:48:08.401533 24686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:56583
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:48:08.453163 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:46587
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:08.579741 25041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:08.580075 25041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:08.580144 25041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:08.581912 25041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:08.582010 25041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:08.582083 25041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:08.584263 25041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.27.148:47481/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:08.584688 25041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:08.584985 25041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:08.591712 25047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:08.591750 25049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:08.592110 25046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:08.593231 25041 server_base.cc:1034] running on GCE node
I20260929 22:48:08.593457 25041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:08.593729 25041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:08.598228 25041 hybrid_clock.cc:648] HybridClock initialized: now 1790722088598202 us; error 37 us; skew 500 ppm
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:08.601629 25041 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:08.602133 25041 webserver.cc:460] Webserver started at http://127.12.27.131:35055/ using document root <none> and password file <none>
I20260929 22:48:08.602485 25041 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:08.602607 25041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:08.602787 25041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:08.617048 25041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "21b2a2970862483cb3aae36e8c2cfcf3"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "eb5b81539332887a796e3f81b8988b0c"
server_key_iv: "7ab48c0ab099780912eb6264bfe18121"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.617646 25041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "21b2a2970862483cb3aae36e8c2cfcf3"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "eb5b81539332887a796e3f81b8988b0c"
server_key_iv: "7ab48c0ab099780912eb6264bfe18121"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.628117 25041 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.001s sys 0.000s
I20260929 22:48:08.647526 25056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.647857 25041 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260929 22:48:08.647962 25041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "21b2a2970862483cb3aae36e8c2cfcf3"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "eb5b81539332887a796e3f81b8988b0c"
server_key_iv: "7ab48c0ab099780912eb6264bfe18121"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.648052 25041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:08.682765 25041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:08.689121 25041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:08.689360 25041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:08.689638 25041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:08.690059 25041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:08.690151 25041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.690222 25041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:08.690286 25041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.704020 25169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:43639 every 8 connection(s)
I20260929 22:48:08.701475 25041 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:43639
I20260929 22:48:08.704627 25041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:48:08.706197 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25041
I20260929 22:48:08.706284 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:48:08.706470 12398 external_mini_cluster.cc:1428] Setting key c171ab79b918a250534415ab92b2a126
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:08.720422 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:08.706849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:60797 (local address 127.12.27.190:46587)
0929 22:48:08.706955 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:08.706958 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:08.708890 (+ 1932us) server_negotiation.cc:407] Connection header received
0929 22:48:08.709568 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:08.709570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:08.709581 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:08.709611 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:08.710464 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.711232 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.712838 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.713158 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.713198 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:08.716489 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:08.716491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:08.716491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:08.716498 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:08.718128 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:08.718619 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:08.718620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:08.718621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:08.718676 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:08.719460 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:08.719461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:08.719461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:08.719594 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:08.719886 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:08.720249 (+ 363us) server_negotiation.cc:299] Negotiation successful
0929 22:48:08.720329 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260929 22:48:08.723760 25172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:08.705766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:46587 (local address 127.12.27.131:60797)
0929 22:48:08.708773 (+ 3007us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:08.708821 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:08.709451 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:08.709792 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:08.709797 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:08.710049 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:08.710360 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:08.710368 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.711349 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.711350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:08.712743 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:08.712746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:08.713326 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:08.713327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:08.713456 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:08.714051 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:08.714061 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:08.716382 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:08.718254 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:08.718260 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:08.718262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:08.718536 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:08.718738 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:08.718739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:08.718739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:08.719384 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:08.719934 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:08.719940 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:08.720098 (+ 158us) client_negotiation.cc:769] Sending connection context
0929 22:48:08.723303 (+ 3205us) client_negotiation.cc:240] Negotiation successful
0929 22:48:08.723493 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2962,"thread_start_us":84,"threads_started":1}
I20260929 22:48:08.726752 25170 heartbeater.cc:347] Connected to a master server at 127.12.27.190:46587
I20260929 22:48:08.726851 25170 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:08.727056 25170 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:08.727474 24686 ts_manager.cc:194] Registered new tserver with Master: 21b2a2970862483cb3aae36e8c2cfcf3 (127.12.27.131:43639)
I20260929 22:48:08.728058 24686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:60797
I20260929 22:48:08.729873 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:48:08.730638 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 24767
I20260929 22:48:08.736188 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 24906
I20260929 22:48:08.744493 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25041
I20260929 22:48:08.751009 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 24654
I20260929 22:48:08.758097 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46587
--webserver_interface=127.12.27.190
--webserver_port=41529
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:46587
--ranger_config_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:08.864346 25173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:08.864588 25173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:08.864629 25173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:08.865792 25173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:08.865859 25173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:08.865882 25173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:08.865904 25173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:08.865932 25173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:08.867522 25173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:46587
--ranger_config_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:08.867794 25173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:08.868008 25173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:08.873714 25178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:08.873732 25179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:08.873956 25173 server_base.cc:1034] running on GCE node
W20260929 22:48:08.874102 25181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:08.874399 25173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:08.874712 25173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:08.875876 25173 hybrid_clock.cc:648] HybridClock initialized: now 1790722088875847 us; error 45 us; skew 500 ppm
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:08.878293 25173 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:08.878759 25173 webserver.cc:460] Webserver started at http://127.12.27.190:41529/ using document root <none> and password file <none>
I20260929 22:48:08.878978 25173 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:08.879026 25173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:48:08 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:08.934355 25173 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:08.935114 25189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:08.935266 25173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:08.935372 25173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "233c322f0b0e446e940d74d77e45450c"
format_stamp: "Formatted at 2026-09-29 22:48:07 on dist-test-slave-00d6"
server_key: "20399866256e8a6a19f10f581691a26e"
server_key_iv: "dc47433a462bb103f92187e40078cd07"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:08.935799 25173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:08.945312 25173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:08.947312 25173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:08.947465 25173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:08.952203 25173 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:46587
I20260929 22:48:08.952284 25241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:46587 every 8 connection(s)
I20260929 22:48:08.952661 25173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:08.953889 25242 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:48:08.954553 25242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Bootstrap starting.
I20260929 22:48:08.955384 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25173
I20260929 22:48:08.955698 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:33443
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:46587
--webserver_port=45583
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:08.964996 25242 log.cc:824] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:08.967536 25242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:08.967926 25242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Bootstrap complete.
I20260929 22:48:08.971379 25242 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:08.971726 25242 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233c322f0b0e446e940d74d77e45450c, State: Initialized, Role: FOLLOWER
I20260929 22:48:08.971932 25242 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:08.971999 25242 raft_consensus.cc:388] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:08.972060 25242 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:08.972131 25242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:48:08.973454 25242 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:08.973560 25242 leader_election.cc:302] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 233c322f0b0e446e940d74d77e45450c; no voters:
I20260929 22:48:08.973750 25242 leader_election.cc:288] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:48:08.973820 25246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:48:08.974063 25242 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:08.974035 25246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [term 2 LEADER]: Becoming Leader. State: Replica: 233c322f0b0e446e940d74d77e45450c, State: Running, Role: LEADER
I20260929 22:48:08.975613 25246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } }
I20260929 22:48:08.975988 25248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233c322f0b0e446e940d74d77e45450c. Latest consensus state: current_term: 2 leader_uuid: "233c322f0b0e446e940d74d77e45450c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } } }
I20260929 22:48:08.976076 25248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:08.976171 25247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "233c322f0b0e446e940d74d77e45450c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233c322f0b0e446e940d74d77e45450c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46587 } } }
I20260929 22:48:08.976223 25247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:08.976388 25260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:08.976572 25242 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 22:48:08.976872 25260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:08.979274 25260 catalog_manager.cc:1259] Loaded cluster ID: d5c57735252e4dcc94871570b08de27a
I20260929 22:48:08.979372 25260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:48:08.981478 25260 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:08.981770 25260 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Loaded TSK: 0
I20260929 22:48:08.982146 25260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:48:09.047168 25244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:09.047374 25244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:09.047410 25244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:09.048617 25244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:09.048684 25244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:09.048728 25244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:09.050942 25244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:33443
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=45583
--tserver_master_addrs=127.12.27.190:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:09.051398 25244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:09.051726 25244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:09.057873 25282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:09.058050 25279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:09.057977 25280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:09.058144 25244 server_base.cc:1034] running on GCE node
I20260929 22:48:09.058344 25244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:09.058595 25244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:09.059752 25244 hybrid_clock.cc:648] HybridClock initialized: now 1790722089059723 us; error 40 us; skew 500 ppm
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:09.062479 25244 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:09.062879 25244 webserver.cc:460] Webserver started at http://127.12.27.129:45583/ using document root <none> and password file <none>
I20260929 22:48:09.063140 25244 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:09.063246 25244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:09.093304 25244 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260929 22:48:09.094327 25290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.094520 25244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:09.094609 25244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "8812459fd2004690a57b26d817d17553"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "c04c5b9e3ca80f6503483b0eb0e6a988"
server_key_iv: "29fc1bef143fc8d630caf04088888ac0"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:09.094987 25244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:09.128448 25244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:09.131047 25244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:09.131263 25244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:09.131567 25244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:09.132009 25244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:09.132102 25244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.132203 25244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:09.132284 25244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.139207 25244 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:33443
I20260929 22:48:09.139321 25403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:33443 every 8 connection(s)
I20260929 22:48:09.139747 25244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:09.145474 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25244
I20260929 22:48:09.145773 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:44511
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:46587
--webserver_port=46151
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:09.157470 25407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.144408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:48109 (local address 127.12.27.190:46587)
0929 22:48:09.144644 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:09.144655 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:09.144820 (+ 165us) server_negotiation.cc:407] Connection header received
0929 22:48:09.145852 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:09.145861 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:09.145925 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:09.146078 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:09.146920 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.148441 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.149900 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.150506 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.150591 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.153353 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:09.153358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:09.153358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:09.153369 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:09.155500 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.156035 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.156038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.156038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.156147 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.156426 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.156427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.156427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.156700 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:09.156751 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:09.157112 (+ 361us) server_negotiation.cc:299] Negotiation successful
0929 22:48:09.157227 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":115,"threads_started":1}
I20260929 22:48:09.158458 25406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.144295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:46587 (local address 127.12.27.129:48109)
0929 22:48:09.144645 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:09.144703 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:09.145392 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:09.146258 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:09.146262 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:09.146505 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:09.146783 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:09.146790 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.148557 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.148558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:09.149772 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:09.149775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.150734 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.150735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:09.150867 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.151494 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:09.151504 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:09.153225 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:09.155601 (+ 2376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:09.155606 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:09.155609 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:09.155934 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:09.156225 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:09.156225 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:09.156226 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:09.156350 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:09.156796 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:09.156800 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:09.156946 (+ 146us) client_negotiation.cc:769] Sending connection context
0929 22:48:09.158093 (+ 1147us) client_negotiation.cc:240] Negotiation successful
0929 22:48:09.158248 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":89,"threads_started":1}
I20260929 22:48:09.159559 25404 heartbeater.cc:347] Connected to a master server at 127.12.27.190:46587
I20260929 22:48:09.159696 25404 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.159900 25404 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
W20260929 22:48:09.160744 25404 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:46587 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 22:48:09.160825 25404 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.160898 25404 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:09.161201 25404 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.161284 25404 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
W20260929 22:48:09.161585 25404 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:48:09.257943 25408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:09.258203 25408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:09.258239 25408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:09.259500 25408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:09.259564 25408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:09.259610 25408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:09.261155 25408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:44511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=46151
--tserver_master_addrs=127.12.27.190:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:09.261430 25408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:09.261713 25408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:09.267678 25416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:09.268080 25413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:09.267617 25414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:09.269312 25408 server_base.cc:1034] running on GCE node
I20260929 22:48:09.269534 25408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:09.269856 25408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:09.271034 25408 hybrid_clock.cc:648] HybridClock initialized: now 1790722089271010 us; error 36 us; skew 500 ppm
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:09.274201 25408 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:09.274647 25408 webserver.cc:460] Webserver started at http://127.12.27.130:46151/ using document root <none> and password file <none>
I20260929 22:48:09.274905 25408 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:09.274986 25408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:09.292079 25408 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260929 22:48:09.296665 25424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.296844 25408 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260929 22:48:09.296931 25408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "abc5248241cf4c95a9094d127e325509"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "e0794bb34177966e20b7c9fe5088c514"
server_key_iv: "a0cfdc297a4f355c408035a0c7ae4f39"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:09.298035 25408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:09.316493 25408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:09.318673 25408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:09.318831 25408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:09.319092 25408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:09.319487 25408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:09.319532 25408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.319598 25408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:09.319646 25408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.326838 25408 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:44511
I20260929 22:48:09.326947 25537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:44511 every 8 connection(s)
I20260929 22:48:09.327287 25408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:48:09.333957 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25408
I20260929 22:48:09.334270 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.27.148:47481/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:43639
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:46587
--webserver_port=35055
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:09.338189 25407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.328114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:57905 (local address 127.12.27.190:46587)
0929 22:48:09.328186 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:09.328189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:09.328453 (+ 264us) server_negotiation.cc:407] Connection header received
0929 22:48:09.329174 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:09.329175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:09.329187 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:09.329250 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:09.329966 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.330607 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.332157 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.332345 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.332405 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.334945 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:09.334946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:09.334947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:09.334954 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:09.336700 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.337197 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.337198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.337198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.337255 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.337532 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.337533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.337533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.337644 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:09.337719 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:09.338012 (+ 293us) server_negotiation.cc:299] Negotiation successful
0929 22:48:09.338099 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:48:09.338385 25540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.328106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:46587 (local address 127.12.27.130:57905)
0929 22:48:09.328304 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:09.328353 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:09.329035 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:09.329326 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:09.329330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:09.329555 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:09.329841 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:09.329848 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.330708 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.330709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:09.332068 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:09.332071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.332454 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.332455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:09.332597 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.333108 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:09.333118 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:09.334818 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:09.336797 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:09.336803 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:09.336806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:09.337117 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:09.337342 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:09.337343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:09.337343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:09.337457 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:09.337710 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:09.337716 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:09.337864 (+ 148us) client_negotiation.cc:769] Sending connection context
0929 22:48:09.337993 (+ 129us) client_negotiation.cc:240] Negotiation successful
0929 22:48:09.338138 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260929 22:48:09.338945 25538 heartbeater.cc:347] Connected to a master server at 127.12.27.190:46587
I20260929 22:48:09.339040 25538 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.339217 25538 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
W20260929 22:48:09.339862 25538 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:46587 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 22:48:09.339946 25538 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.340018 25538 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:09.340298 25538 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.340372 25538 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
W20260929 22:48:09.340652 25538 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:48:09.444921 25541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:09.445255 25541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:09.445329 25541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:09.447022 25541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:09.447113 25541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:09.447183 25541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:09.449361 25541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.27.148:47481/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:43639
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=35055
--tserver_master_addrs=127.12.27.190:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:09.449609 25541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:09.449923 25541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:09.456262 25549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:09.456346 25547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:09.456269 25546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:09.456763 25541 server_base.cc:1034] running on GCE node
I20260929 22:48:09.456992 25541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:09.457283 25541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:09.458463 25541 hybrid_clock.cc:648] HybridClock initialized: now 1790722089458436 us; error 39 us; skew 500 ppm
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:09.462522 25541 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:09.463131 25541 webserver.cc:460] Webserver started at http://127.12.27.131:35055/ using document root <none> and password file <none>
I20260929 22:48:09.463438 25541 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:09.463541 25541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:09.483875 25541 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 22:48:09.484956 25558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.485138 25541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:09.485232 25541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "21b2a2970862483cb3aae36e8c2cfcf3"
format_stamp: "Formatted at 2026-09-29 22:48:08 on dist-test-slave-00d6"
server_key: "eb5b81539332887a796e3f81b8988b0c"
server_key_iv: "7ab48c0ab099780912eb6264bfe18121"
server_key_version: "kuduclusterkey@0"
I20260929 22:48:09.485574 25541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:09.517087 25541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:09.519287 25541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:09.519455 25541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:09.519729 25541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:09.520057 25541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:09.520108 25541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.520176 25541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:09.520206 25541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:09.527379 25541 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:43639
I20260929 22:48:09.527964 25541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:48:09.528671 25671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:43639 every 8 connection(s)
I20260929 22:48:09.531430 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25541
Sep 29 22:48:09 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722089, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:09.540529 25674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.529400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:46587 (local address 127.12.27.131:47207)
0929 22:48:09.529972 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:09.530030 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:09.530680 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:09.530993 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:09.530998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:09.531222 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:09.531503 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:09.531509 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.532592 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.532592 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:09.533842 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:09.533845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.534423 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.534425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:09.534569 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.535213 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:09.535228 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:09.536732 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:09.538807 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:09.538814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:09.538816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:09.539135 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:09.539386 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:09.539386 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:09.539387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:09.539524 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:09.539844 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:09.539850 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:09.540011 (+ 161us) client_negotiation.cc:769] Sending connection context
0929 22:48:09.540122 (+ 111us) client_negotiation.cc:240] Negotiation successful
0929 22:48:09.540278 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":79,"threads_started":1}
I20260929 22:48:09.540972 25407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.529680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:47207 (local address 127.12.27.190:46587)
0929 22:48:09.529727 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:09.529729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:09.530148 (+ 419us) server_negotiation.cc:407] Connection header received
0929 22:48:09.530811 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:09.530812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:09.530825 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:09.530907 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:09.531620 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.532470 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.533931 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.534241 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.534321 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.536842 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:09.536844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:09.536844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:09.536851 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:09.538709 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.539241 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.539242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.539242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.539302 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.539601 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.539602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.539602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.539751 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:09.539817 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:09.540787 (+ 970us) server_negotiation.cc:299] Negotiation successful
0929 22:48:09.540868 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:48:09.541326 25672 heartbeater.cc:347] Connected to a master server at 127.12.27.190:46587
I20260929 22:48:09.541463 25672 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.541654 25672 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
W20260929 22:48:09.542281 25672 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:46587 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 22:48:09.542357 25672 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.542402 25675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:09.531860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57186 (local address 127.12.27.190:46587)
0929 22:48:09.534158 (+ 2298us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:09.534161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:09.534167 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:48:09.534187 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:09.534188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:09.534199 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:09.534250 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:09.534978 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.535765 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.536800 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:09.537022 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:09.537350 (+ 328us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:09.538711 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:09.538712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:09.538713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:09.538720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:09.540196 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.540523 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.540524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.540524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.540598 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:09.541012 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:09.541012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:09.541013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:09.541150 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:09.541300 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:09.542215 (+ 915us) server_negotiation.cc:299] Negotiation successful
0929 22:48:09.542293 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2280,"thread_start_us":58,"threads_started":1}
I20260929 22:48:09.542428 25672 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:09.542976 25672 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:09.543058 25672 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
W20260929 22:48:09.543349 25672 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 29 22:48:10 dist-test-slave-00d6 krb5kdc[24210](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790722090, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:10.161782 25404 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:10.161960 25404 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:10.162349 25206 ts_manager.cc:194] Registered new tserver with Master: 8812459fd2004690a57b26d817d17553 (127.12.27.129:33443)
I20260929 22:48:10.163048 25206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:48109
I20260929 22:48:10.340848 25538 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:10.341017 25538 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:10.341300 25206 ts_manager.cc:194] Registered new tserver with Master: abc5248241cf4c95a9094d127e325509 (127.12.27.130:44511)
I20260929 22:48:10.341846 25206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:57905
Sep 29 22:48:10 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722090, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:10.543555 25672 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:10.543727 25672 heartbeater.cc:511] Master 127.12.27.190:46587 requested a full tablet report, sending...
I20260929 22:48:10.544107 25206 ts_manager.cc:194] Registered new tserver with Master: 21b2a2970862483cb3aae36e8c2cfcf3 (127.12.27.131:43639)
I20260929 22:48:10.544711 25206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:47207
I20260929 22:48:10.547339 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:48:10.557650 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.548372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.12.27.190:46587)
0929 22:48:10.548666 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.548669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.548676 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:48:10.548699 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.548700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.548711 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.548780 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:10.549610 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.550487 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.551683 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.552022 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.552098 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.553818 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:10.553819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:10.553819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:10.553827 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:10.556027 (+ 2200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:10.556443 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:10.556444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:10.556445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:10.556510 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:10.556724 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:10.556725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:10.556725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:10.556864 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:10.556980 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.557458 (+ 478us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.557548 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":66,"threads_started":1}
I20260929 22:48:10.559952 25206 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:48:10.562312 25206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:48:10.571043 25699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.565409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:44511 (local address 127.0.0.1:45352)
0929 22:48:10.565592 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:10.565631 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:10.565703 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:10.566705 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:10.566708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:10.566711 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:10.566780 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.566782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.568092 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.568093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.569404 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.569407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.570666 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.570667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.570763 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.570781 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 22:48:10.570837 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:48:10.570891 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260929 22:48:10.572413 25704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.566112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.12.27.130:44511)
0929 22:48:10.566524 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.566529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.566539 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:48:10.566576 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.566578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.566595 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.566689 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:10.566861 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.567968 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.569777 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.570561 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.571697 (+ 1136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.572073 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.572102 (+ 29us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.572141 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":57,"threads_started":1}
I20260929 22:48:10.573268 25472 tablet_service.cc:1467] Processing CreateTablet for tablet 461c8c04dd424e93ac6b3f793e806eae (DEFAULT_TABLE table=test-table [id=8094ef1a4160442ebd0d1ac43812dce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:10.573644 25472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461c8c04dd424e93ac6b3f793e806eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:10.575007 25699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.565848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:33443 (local address 127.0.0.1:56250)
0929 22:48:10.571132 (+ 5284us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:10.571143 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:10.571198 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:10.571443 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:10.571444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:10.571446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:10.571474 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.571475 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.572729 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.572730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.573716 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.573719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.574746 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.574747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.574806 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.574809 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:48:10.574879 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:48:10.574940 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5272,"thread_start_us":91,"threads_started":1}
I20260929 22:48:10.575057 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.565963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.12.27.129:33443)
0929 22:48:10.566243 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.566248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.571202 (+ 4954us) server_negotiation.cc:407] Connection header received
0929 22:48:10.571253 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.571256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.571273 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.571356 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:10.571545 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.572634 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.573815 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.574591 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.574663 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.574713 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.574924 (+ 211us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.574969 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":56,"threads_started":1}
I20260929 22:48:10.575742 25702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.565677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:43639 (local address 127.0.0.1:55344)
0929 22:48:10.566097 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:10.566107 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:10.566154 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:10.567932 (+ 1778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:10.567933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:10.567935 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:10.567978 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.567980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.569299 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.569300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.570413 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.570416 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.575512 (+ 5096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.575513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.575570 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.575574 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:10.575602 (+ 28us) client_negotiation.cc:240] Negotiation successful
0929 22:48:10.575668 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":19,"thread_start_us":65,"threads_started":1}
I20260929 22:48:10.575743 25324 tablet_service.cc:1467] Processing CreateTablet for tablet 461c8c04dd424e93ac6b3f793e806eae (DEFAULT_TABLE table=test-table [id=8094ef1a4160442ebd0d1ac43812dce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:10.576081 25324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461c8c04dd424e93ac6b3f793e806eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:10.576191 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.565783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55344 (local address 127.12.27.131:43639)
0929 22:48:10.567748 (+ 1965us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.567752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.567764 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:48:10.567797 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.567798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.567814 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.568050 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:10.568124 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.569173 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.570515 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.575412 (+ 4897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.575984 (+ 572us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.576049 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.576077 (+ 28us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.576118 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1930,"thread_start_us":75,"threads_started":1}
I20260929 22:48:10.576787 25593 tablet_service.cc:1467] Processing CreateTablet for tablet 461c8c04dd424e93ac6b3f793e806eae (DEFAULT_TABLE table=test-table [id=8094ef1a4160442ebd0d1ac43812dce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:10.577097 25593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461c8c04dd424e93ac6b3f793e806eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:10.580636 25707 tablet_bootstrap.cc:492] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: Bootstrap starting.
I20260929 22:48:10.581281 25707 tablet_bootstrap.cc:654] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:10.581568 25707 log.cc:824] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:10.582319 25707 tablet_bootstrap.cc:492] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: No bootstrap required, opened a new log
I20260929 22:48:10.582381 25707 ts_tablet_manager.cc:1397] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:10.584872 25707 raft_consensus.cc:348] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.585039 25707 raft_consensus.cc:374] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:10.585071 25707 raft_consensus.cc:729] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8812459fd2004690a57b26d817d17553, State: Initialized, Role: FOLLOWER
I20260929 22:48:10.585186 25707 consensus_queue.cc:260] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.585445 25707 ts_tablet_manager.cc:1428] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:48:10.585484 25404 heartbeater.cc:503] Master 127.12.27.190:46587 was elected leader, sending a full tablet report...
I20260929 22:48:10.587831 25705 tablet_bootstrap.cc:492] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Bootstrap starting.
I20260929 22:48:10.587836 25706 tablet_bootstrap.cc:492] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Bootstrap starting.
I20260929 22:48:10.588505 25706 tablet_bootstrap.cc:654] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:10.588665 25705 tablet_bootstrap.cc:654] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:10.589325 25706 log.cc:824] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:10.589450 25705 log.cc:824] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:10.590518 25705 tablet_bootstrap.cc:492] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: No bootstrap required, opened a new log
I20260929 22:48:10.590531 25706 tablet_bootstrap.cc:492] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: No bootstrap required, opened a new log
I20260929 22:48:10.590581 25705 ts_tablet_manager.cc:1397] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:48:10.590591 25706 ts_tablet_manager.cc:1397] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:48:10.593256 25705 raft_consensus.cc:348] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.593267 25706 raft_consensus.cc:348] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.593425 25705 raft_consensus.cc:374] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:10.593426 25706 raft_consensus.cc:374] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:10.593457 25705 raft_consensus.cc:729] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abc5248241cf4c95a9094d127e325509, State: Initialized, Role: FOLLOWER
I20260929 22:48:10.593462 25706 raft_consensus.cc:729] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b2a2970862483cb3aae36e8c2cfcf3, State: Initialized, Role: FOLLOWER
I20260929 22:48:10.593564 25706 consensus_queue.cc:260] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.593575 25705 consensus_queue.cc:260] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.593830 25705 ts_tablet_manager.cc:1428] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:48:10.593832 25706 ts_tablet_manager.cc:1428] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:48:10.593962 25672 heartbeater.cc:503] Master 127.12.27.190:46587 was elected leader, sending a full tablet report...
I20260929 22:48:10.594089 25538 heartbeater.cc:503] Master 127.12.27.190:46587 was elected leader, sending a full tablet report...
W20260929 22:48:10.641162 25405 tablet.cc:2369] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 22:48:10 dist-test-slave-00d6 krb5kdc[24210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722090, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for HTTP/127.12.27.148@KRBTEST.COM
I20260929 22:48:10.731855 25709 raft_consensus.cc:482] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:10.732038 25709 raft_consensus.cc:504] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.732435 25709 leader_election.cc:288] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abc5248241cf4c95a9094d127e325509 (127.12.27.130:44511), 21b2a2970862483cb3aae36e8c2cfcf3 (127.12.27.131:43639)
I20260929 22:48:10.736445 25704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.732949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:33141 (local address 127.12.27.130:44511)
0929 22:48:10.732990 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.732992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.733000 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:48:10.733030 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.733031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.733042 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.733091 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:10.733330 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.734034 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.735450 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.736022 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.736072 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.736083 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.736315 (+ 232us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.736356 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:48:10.736904 25716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.732576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:44511 (local address 127.12.27.129:33141)
0929 22:48:10.732761 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:10.732774 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:10.732826 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:10.733151 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:10.733152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:10.733154 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:10.733239 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.733241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.734142 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.734143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.735332 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.735335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.736164 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.736165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.736233 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.736238 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:48:10.736762 (+ 524us) client_negotiation.cc:240] Negotiation successful
0929 22:48:10.736809 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":83,"threads_started":1}
I20260929 22:48:10.737403 25478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461c8c04dd424e93ac6b3f793e806eae" candidate_uuid: "8812459fd2004690a57b26d817d17553" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abc5248241cf4c95a9094d127e325509" is_pre_election: true
I20260929 22:48:10.737576 25478 raft_consensus.cc:2454] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8812459fd2004690a57b26d817d17553 in term 0.
I20260929 22:48:10.737900 25293 leader_election.cc:302] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8812459fd2004690a57b26d817d17553, abc5248241cf4c95a9094d127e325509; no voters:
I20260929 22:48:10.738034 25709 raft_consensus.cc:2781] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:48:10.738080 25709 raft_consensus.cc:482] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:48:10.738102 25709 raft_consensus.cc:3037] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:10.739075 25709 raft_consensus.cc:504] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.739208 25709 leader_election.cc:288] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [CANDIDATE]: Term 1 election: Requested vote from peers abc5248241cf4c95a9094d127e325509 (127.12.27.130:44511), 21b2a2970862483cb3aae36e8c2cfcf3 (127.12.27.131:43639)
I20260929 22:48:10.739434 25478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461c8c04dd424e93ac6b3f793e806eae" candidate_uuid: "8812459fd2004690a57b26d817d17553" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abc5248241cf4c95a9094d127e325509"
I20260929 22:48:10.739521 25478 raft_consensus.cc:3037] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:10.740581 25478 raft_consensus.cc:2454] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8812459fd2004690a57b26d817d17553 in term 1.
I20260929 22:48:10.740939 25293 leader_election.cc:302] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8812459fd2004690a57b26d817d17553, abc5248241cf4c95a9094d127e325509; no voters:
I20260929 22:48:10.741062 25709 raft_consensus.cc:2781] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:10.741202 25709 raft_consensus.cc:686] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [term 1 LEADER]: Becoming Leader. State: Replica: 8812459fd2004690a57b26d817d17553, State: Running, Role: LEADER
I20260929 22:48:10.741287 25709 consensus_queue.cc:237] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } }
I20260929 22:48:10.742105 25206 catalog_manager.cc:5495] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8812459fd2004690a57b26d817d17553 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "8812459fd2004690a57b26d817d17553" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8812459fd2004690a57b26d817d17553" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33443 } health_report { overall_health: HEALTHY } } }
I20260929 22:48:10.742686 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.733000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:44687 (local address 127.12.27.131:43639)
0929 22:48:10.733042 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.733044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.738981 (+ 5937us) server_negotiation.cc:407] Connection header received
0929 22:48:10.739032 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.739033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.739045 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.739106 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:10.739303 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.740094 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.741653 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.742234 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.742289 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.742299 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.742569 (+ 270us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.742614 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:48:10.742942 25717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.732780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:43639 (local address 127.12.27.129:44687)
0929 22:48:10.738877 (+ 6097us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:10.738891 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:10.738971 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:10.739124 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:10.739126 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:10.739128 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:10.739192 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.739194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.740210 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.740211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.741520 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:10.741523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.742366 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.742367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:10.742456 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.742460 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:10.742811 (+ 351us) client_negotiation.cc:240] Negotiation successful
0929 22:48:10.742854 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6075,"thread_start_us":60,"threads_started":1}
I20260929 22:48:10.744750 25625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461c8c04dd424e93ac6b3f793e806eae" candidate_uuid: "8812459fd2004690a57b26d817d17553" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b2a2970862483cb3aae36e8c2cfcf3"
I20260929 22:48:10.744884 25625 raft_consensus.cc:3037] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:10.745833 25625 raft_consensus.cc:2454] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8812459fd2004690a57b26d817d17553 in term 1.
I20260929 22:48:10.746027 25626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461c8c04dd424e93ac6b3f793e806eae" candidate_uuid: "8812459fd2004690a57b26d817d17553" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" is_pre_election: true
I20260929 22:48:10.746114 25626 raft_consensus.cc:2362] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8812459fd2004690a57b26d817d17553 in term 1. Re-sending same reply.
I20260929 22:48:10.762528 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.759267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56266 (local address 127.12.27.129:33443)
0929 22:48:10.759307 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:10.759308 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:10.759315 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:48:10.759352 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:10.759352 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:10.759373 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:10.759436 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:10.759619 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.760350 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.761437 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:10.761716 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:10.761785 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:10.762002 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:10.762132 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:10.762205 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:10.762431 (+ 226us) server_negotiation.cc:299] Negotiation successful
0929 22:48:10.762452 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:48:10.765024 25626 raft_consensus.cc:1261] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 1 FOLLOWER]: Refusing update from remote peer 8812459fd2004690a57b26d817d17553: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:10.765363 25478 raft_consensus.cc:1261] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 1 FOLLOWER]: Refusing update from remote peer 8812459fd2004690a57b26d817d17553: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:10.765856 25709 consensus_queue.cc:1035] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b2a2970862483cb3aae36e8c2cfcf3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 43639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:10.766042 25709 consensus_queue.cc:1035] T 461c8c04dd424e93ac6b3f793e806eae P 8812459fd2004690a57b26d817d17553 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abc5248241cf4c95a9094d127e325509" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 44511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:10.771036 25721 mvcc.cc:205] Tried to move back new op lower bound from 7334797683769937920 to 7334797683676876800. Current Snapshot: MvccSnapshot[applied={T|T < 7334797683769937920}]
I20260929 22:48:10.771207 25723 mvcc.cc:205] Tried to move back new op lower bound from 7334797683769937920 to 7334797683676876800. Current Snapshot: MvccSnapshot[applied={T|T < 7334797683769937920}]
I20260929 22:48:10.773620 25722 mvcc.cc:205] Tried to move back new op lower bound from 7334797683769937920 to 7334797683676876800. Current Snapshot: MvccSnapshot[applied={T|T < 7334797683769937920}]
I20260929 22:48:10.778750 25205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:10.778852 25205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:10.779795 25205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 233c322f0b0e446e940d74d77e45450c: Sending DeleteTablet for 3 replicas of tablet 461c8c04dd424e93ac6b3f793e806eae
I20260929 22:48:10.780373 25472 tablet_service.cc:1514] Processing DeleteTablet for tablet 461c8c04dd424e93ac6b3f793e806eae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:10 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:45352
I20260929 22:48:10.780629 25593 tablet_service.cc:1514] Processing DeleteTablet for tablet 461c8c04dd424e93ac6b3f793e806eae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:10 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:55344
I20260929 22:48:10.780864 25324 tablet_service.cc:1514] Processing DeleteTablet for tablet 461c8c04dd424e93ac6b3f793e806eae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:10 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:56250
I20260929 22:48:10.781690 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25244
I20260929 22:48:10.786818 25733 tablet_replica.cc:330] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: stopping tablet replica
I20260929 22:48:10.787015 25732 tablet_replica.cc:330] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: stopping tablet replica
I20260929 22:48:10.787230 25732 raft_consensus.cc:2229] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:10.787374 25733 raft_consensus.cc:2229] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:10.787541 25733 raft_consensus.cc:2258] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:10.787710 25732 raft_consensus.cc:2258] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:10.788331 25733 ts_tablet_manager.cc:1905] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:10.788823 25732 ts_tablet_manager.cc:1905] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:10.796141 25733 ts_tablet_manager.cc:1918] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:10.797485 25732 ts_tablet_manager.cc:1918] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:10.797648 25733 log.cc:1196] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/461c8c04dd424e93ac6b3f793e806eae
I20260929 22:48:10.798053 25733 ts_tablet_manager.cc:1939] T 461c8c04dd424e93ac6b3f793e806eae P 21b2a2970862483cb3aae36e8c2cfcf3: Deleting consensus metadata
I20260929 22:48:10.798202 25732 log.cc:1196] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/461c8c04dd424e93ac6b3f793e806eae
I20260929 22:48:10.798575 25732 ts_tablet_manager.cc:1939] T 461c8c04dd424e93ac6b3f793e806eae P abc5248241cf4c95a9094d127e325509: Deleting consensus metadata
I20260929 22:48:10.799135 25192 catalog_manager.cc:4841] TS 21b2a2970862483cb3aae36e8c2cfcf3 (127.12.27.131:43639): tablet 461c8c04dd424e93ac6b3f793e806eae (table test-table [id=8094ef1a4160442ebd0d1ac43812dce2]) successfully deleted
I20260929 22:48:10.799721 25192 catalog_manager.cc:4841] TS abc5248241cf4c95a9094d127e325509 (127.12.27.130:44511): tablet 461c8c04dd424e93ac6b3f793e806eae (table test-table [id=8094ef1a4160442ebd0d1ac43812dce2]) successfully deleted
W20260929 22:48:10.800256 25192 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:33443 (error 108)
I20260929 22:48:10.800944 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25408
I20260929 22:48:10.807163 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25541
I20260929 22:48:10.811336 25702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:10.811187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:33443 (local address 127.0.0.1:56274)
0929 22:48:10.811247 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:10.811294 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:33443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 22:48:10.811569 25192 catalog_manager.cc:4584] TS 8812459fd2004690a57b26d817d17553 (127.12.27.129:33443): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 461c8c04dd424e93ac6b3f793e806eae: Network error: Client connection negotiation failed: client connection to 127.12.27.129:33443: connect: Connection refused (error 111)
I20260929 22:48:10.816362 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25173
I20260929 22:48:10.823527 12398 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 22:48:11.157683 12398 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 22:48:11.157940 12398 mini_ranger.cc:66] Stopping Ranger...
I20260929 22:48:11.502139 12398 mini_ranger.cc:68] Stopped Ranger
2026-09-29 22:48:11.502 UTC [24240] LOG: received smart shutdown request
2026-09-29 22:48:11.506 UTC [24240] LOG: background worker "logical replication launcher" (PID 24249) exited with exit code 1
2026-09-29 22:48:11.506 UTC [24244] LOG: shutting down
2026-09-29 22:48:11.680 UTC [24240] LOG: database system is shut down
2026-09-29T22:48:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47100 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:48:11 dist-test-slave-00d6 krb5kdc[25744](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:48:11 dist-test-slave-00d6 krb5kdc[25744](info): set up 2 sockets
Sep 29 22:48:11 dist-test-slave-00d6 krb5kdc[25744](info): commencing operation
krb5kdc: starting...
W20260929 22:48:12.836097 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:48:12 dist-test-slave-00d6 krb5kdc[25744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:48:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:48:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:48:12.950240 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41275
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:41275,127.12.27.189:46019,127.12.27.188:44295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:13.031371 25757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:13.031620 25757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:13.031680 25757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:13.032835 25757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:13.032914 25757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:13.032941 25757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:13.033003 25757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:13.033027 25757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:13.034560 25757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:41275,127.12.27.189:46019,127.12.27.188:44295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:13.034827 25757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:13.035054 25757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:13.040009 25765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:13.040158 25757 server_base.cc:1034] running on GCE node
W20260929 22:48:13.040037 25762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:13.040035 25763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:13.040578 25757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:13.040941 25757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:13.042128 25757 hybrid_clock.cc:648] HybridClock initialized: now 1790722093042112 us; error 27 us; skew 500 ppm
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:13.044788 25757 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:13.045302 25757 webserver.cc:460] Webserver started at http://127.12.27.190:43721/ using document root <none> and password file <none>
I20260929 22:48:13.045540 25757 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:13.045609 25757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:13.045763 25757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:13.046916 25757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "06bdcb790d9dea3b6f087d85196d14c2"
server_key_iv: "adff28dcf57004fba853759a5d5485e7"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.047305 25757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "06bdcb790d9dea3b6f087d85196d14c2"
server_key_iv: "adff28dcf57004fba853759a5d5485e7"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.048800 25757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:48:13.049582 25772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:13.049750 25757 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:13.049886 25757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "06bdcb790d9dea3b6f087d85196d14c2"
server_key_iv: "adff28dcf57004fba853759a5d5485e7"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.049969 25757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:13.062922 25757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:13.065204 25757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:13.065327 25757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:13.069388 25757 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:41275
I20260929 22:48:13.069417 25824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:41275 every 8 connection(s)
I20260929 22:48:13.069789 25757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:13.070722 25825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:13.072319 25825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:48:13.074734 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25757
I20260929 22:48:13.074873 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:48:13.075049 12398 external_mini_cluster.cc:1428] Setting key 2c97e15327b7c011452257af33473ee8
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.189@KRBTEST.COM; defaulting to no policy
I20260929 22:48:13.083441 25828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.073126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51024 (local address 127.12.27.190:41275)
0929 22:48:13.073263 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.073267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.073296 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:48:13.073730 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.073733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.073750 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.073833 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.074327 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.075447 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.076771 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.077309 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.077438 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.080087 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.080094 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.080094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.080100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.081876 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.082321 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.082323 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.082323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.082404 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.082670 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.082671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.082671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.082905 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.082975 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.083138 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.083228 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":63,"threads_started":1}
I20260929 22:48:13.083448 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.072984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41275 (local address 127.0.0.1:51024)
0929 22:48:13.073129 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.073163 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.073586 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.073857 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.073859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.074095 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.074243 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.074246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.075543 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.075544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.076675 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.076677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.077463 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.077464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.077521 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.078121 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.078130 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.079998 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.081965 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.081972 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.081975 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.082233 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.082472 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.082473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.082474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.082587 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.082972 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.082978 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.083035 (+ 57us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.083111 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.083307 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":79,"thread_start_us":60,"threads_started":1}
I20260929 22:48:13.084275 25825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:48:13.084646 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.084508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56734)
0929 22:48:13.084578 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.084624 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260929 22:48:13.084792 25775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
I20260929 22:48:13.085218 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.085121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56746)
0929 22:48:13.085165 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.085193 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.189@KRBTEST.COM" created.
W20260929 22:48:13.085351 25825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:46019: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab.
Entry for principal kudu/127.12.27.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab.
I20260929 22:48:13.100085 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:46019
--webserver_interface=127.12.27.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab
--principal=kudu/127.12.27.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:41275,127.12.27.189:46019,127.12.27.188:44295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:13.134586 25825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } attempt: 1
I20260929 22:48:13.135143 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.135004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56754)
0929 22:48:13.135072 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.135114 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 22:48:13.135524 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.135428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56766)
0929 22:48:13.135476 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.135504 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 22:48:13.135651 25825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:46019: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
W20260929 22:48:13.181195 25832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:13.181413 25832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:13.181435 25832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:13.182571 25832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:13.182614 25832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:13.182628 25832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:13.182641 25832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:13.182653 25832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:13.184234 25832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:41275,127.12.27.189:46019,127.12.27.188:44295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab
--principal=kudu/127.12.27.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:46019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.27.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:13.184528 25832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:13.184749 25832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:13.189455 25838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:13.189595 25840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:13.189466 25837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:13.189581 25832 server_base.cc:1034] running on GCE node
I20260929 22:48:13.189837 25832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:13.190100 25832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:13.191244 25832 hybrid_clock.cc:648] HybridClock initialized: now 1790722093191225 us; error 30 us; skew 500 ppm
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:13.193708 25832 init.cc:377] Logged in from keytab as kudu/127.12.27.189@KRBTEST.COM (short username kudu)
I20260929 22:48:13.194133 25832 webserver.cc:460] Webserver started at http://127.12.27.189:41383/ using document root <none> and password file <none>
I20260929 22:48:13.194361 25832 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:13.194425 25832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:13.194571 25832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:13.195613 25832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data/instance:
uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "18c33197d06fd64d2235e50b6157ddea"
server_key_iv: "c4dace9f7b643804696ed5f91bae039b"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.196029 25832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal/instance:
uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "18c33197d06fd64d2235e50b6157ddea"
server_key_iv: "c4dace9f7b643804696ed5f91bae039b"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.197297 25832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:48:13.198045 25847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:13.198230 25832 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:48:13.198323 25832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal
uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "18c33197d06fd64d2235e50b6157ddea"
server_key_iv: "c4dace9f7b643804696ed5f91bae039b"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.198402 25832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:13.203783 25825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } attempt: 2
I20260929 22:48:13.204162 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.204035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56782)
0929 22:48:13.204091 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.204129 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 22:48:13.204545 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.204451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56792)
0929 22:48:13.204495 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.204523 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:48:13.204651 25825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:46019: Network error: Client connection negotiation failed: client connection to 127.12.27.189:46019: connect: Connection refused (error 111)
I20260929 22:48:13.216032 25832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:13.218000 25832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:13.218118 25832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:13.222522 25832 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.189:46019
I20260929 22:48:13.222627 25899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.189:46019 every 8 connection(s)
I20260929 22:48:13.222968 25832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
I20260929 22:48:13.223917 25900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:13.224725 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25832
I20260929 22:48:13.224830 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-1/wal/instance
I20260929 22:48:13.225039 12398 external_mini_cluster.cc:1428] Setting key 32e91bbdfa45fc67081fcf214b7df7c0
I20260929 22:48:13.226150 25900 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.188@KRBTEST.COM" created.
I20260929 22:48:13.236403 25828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.227036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.12.27.190:41275)
0929 22:48:13.227095 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.227097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.227328 (+ 231us) server_negotiation.cc:407] Connection header received
0929 22:48:13.227944 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.227946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.227963 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.228031 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.228690 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.229583 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.230557 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.230935 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.231023 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.233096 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.233098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.233098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.233109 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.234670 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.235249 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.235250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.235251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.235309 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.235648 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.235650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.235650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.235798 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.235883 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.236186 (+ 303us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.236297 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:48:13.236613 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.227028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41275 (local address 127.0.0.1:51026)
0929 22:48:13.227212 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.227246 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.227813 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.228106 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.228109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.228363 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.228554 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.228558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.229689 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.229690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.230467 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.230469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.231026 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.231027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.231135 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.231669 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.231678 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.233001 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.234881 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.234889 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.234891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.235154 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.235383 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.235384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.235384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.235487 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.235888 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.235895 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.236039 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.236156 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.236362 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260929 22:48:13.237234 25900 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:48:13.244904 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.237534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56794)
0929 22:48:13.237588 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.237599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.237641 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.237887 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.237888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.238028 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.238069 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.238070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.238915 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.238916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.239405 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.239406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.239960 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.239961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.240026 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.240483 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.240487 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.241846 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.243884 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.243885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.243885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.244057 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.244251 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.244252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.244252 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.244302 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.244565 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.244566 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.244617 (+ 51us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.244686 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.244788 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 22:48:13.245013 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.237608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56794 (local address 127.12.27.189:46019)
0929 22:48:13.237766 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.237769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.237784 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:48:13.237800 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.237801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.237811 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.237887 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.238140 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.238814 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.239503 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.239869 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.239961 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.241937 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.241946 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.241946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.241954 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.243799 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.244136 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.244138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.244139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.244193 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.244354 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.244355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.244355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.244490 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.244552 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.244734 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.244859 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260929 22:48:13.245571 25900 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:48:13.245934 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.245794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44192)
0929 22:48:13.245844 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.245904 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 22:48:13.246074 25851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
I20260929 22:48:13.246521 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.246412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44204)
0929 22:48:13.246482 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.246505 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260929 22:48:13.246632 25900 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44295: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab.
Entry for principal kudu/127.12.27.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab.
I20260929 22:48:13.250711 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:44295
--webserver_interface=127.12.27.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab
--principal=kudu/127.12.27.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:41275,127.12.27.189:46019,127.12.27.188:44295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:13.295804 25825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } attempt: 3
I20260929 22:48:13.295852 25900 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } attempt: 1
I20260929 22:48:13.296456 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.296190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44214)
0929 22:48:13.296307 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.296350 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260929 22:48:13.296830 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.296725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44226)
0929 22:48:13.296774 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.296805 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:48:13.296928 25900 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44295: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:48:13.303392 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.296277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.12.27.189:46019)
0929 22:48:13.296329 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.296331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.296383 (+ 52us) server_negotiation.cc:407] Connection header received
0929 22:48:13.296445 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.296446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.296457 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.296523 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.296949 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.297460 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.298493 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.298702 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.298764 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.300909 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.300910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.300911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.300918 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.302328 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.302654 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.302655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.302656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.302710 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.302901 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.302902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.302902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.303008 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.303086 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.303232 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.303305 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 22:48:13.303412 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.296270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56798)
0929 22:48:13.296321 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.296330 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.296386 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.296560 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.296562 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.296764 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.296843 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.296846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.297541 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.297542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.298391 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.298394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.298775 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.298776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.298859 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.299303 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.299308 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.300804 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.302405 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.302406 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.302406 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.302574 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.302774 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.302775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.302775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.302833 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.303078 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.303079 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.303127 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.303208 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.303305 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:48:13.303913 25825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:48:13.304226 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.304141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44228)
0929 22:48:13.304182 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.304209 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 22:48:13.304533 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.304445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44232)
0929 22:48:13.304490 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.304512 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:48:13.304631 25825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44295: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
W20260929 22:48:13.333626 25907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:13.333842 25907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:13.333879 25907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:13.334983 25907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:13.335057 25907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:13.335085 25907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:13.335124 25907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:13.335162 25907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:13.335774 25825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } attempt: 1
I20260929 22:48:13.336172 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.336057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44248)
0929 22:48:13.336112 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.336146 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:48:13.336529 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.336394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44264)
0929 22:48:13.336477 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.336504 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260929 22:48:13.336607 25825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44295: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
I20260929 22:48:13.336935 25907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:41275,127.12.27.189:46019,127.12.27.188:44295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab
--principal=kudu/127.12.27.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:44295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.27.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:13.337168 25907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:13.337383 25907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:13.342088 25913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:13.342088 25915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:13.342135 25912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:13.342211 25907 server_base.cc:1034] running on GCE node
I20260929 22:48:13.342557 25907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:13.342832 25907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:13.344017 25907 hybrid_clock.cc:648] HybridClock initialized: now 1790722093344003 us; error 28 us; skew 500 ppm
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:13.346473 25907 init.cc:377] Logged in from keytab as kudu/127.12.27.188@KRBTEST.COM (short username kudu)
I20260929 22:48:13.346841 25907 webserver.cc:460] Webserver started at http://127.12.27.188:36561/ using document root <none> and password file <none>
I20260929 22:48:13.347020 25907 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:13.347060 25907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:13.347143 25907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:13.348174 25907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data/instance:
uuid: "20e4228dc8b344468c68a5adc21cb109"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "628e2216c89e91a60b4e8768141d8bf8"
server_key_iv: "cf712f3f762f7f611720297797aa3938"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.348469 25907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal/instance:
uuid: "20e4228dc8b344468c68a5adc21cb109"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "628e2216c89e91a60b4e8768141d8bf8"
server_key_iv: "cf712f3f762f7f611720297797aa3938"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.349709 25907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:48:13.350427 25922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:13.350593 25907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:13.350672 25907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal
uuid: "20e4228dc8b344468c68a5adc21cb109"
format_stamp: "Formatted at 2026-09-29 22:48:13 on dist-test-slave-00d6"
server_key: "628e2216c89e91a60b4e8768141d8bf8"
server_key_iv: "cf712f3f762f7f611720297797aa3938"
server_key_version: "encryptionkey@0"
I20260929 22:48:13.350725 25907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:13.365065 25900 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } attempt: 2
I20260929 22:48:13.365615 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.365475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44278)
0929 22:48:13.365534 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.365579 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:48:13.366014 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.365918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44282)
0929 22:48:13.365963 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.365993 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 22:48:13.366122 25900 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44295: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44295: connect: Connection refused (error 111)
I20260929 22:48:13.379488 25907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:13.381524 25907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:13.381693 25907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:13.385514 25907 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.188:44295
I20260929 22:48:13.385551 25974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.188:44295 every 8 connection(s)
I20260929 22:48:13.385977 25907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
I20260929 22:48:13.386852 25975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:13.388497 25975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:13.395937 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 25907
I20260929 22:48:13.396051 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790721915685765-12398-0/minicluster-data/master-2/wal/instance
I20260929 22:48:13.396270 12398 external_mini_cluster.cc:1428] Setting key 48a4083ce2b4bb8c2164ad423e37a1d2
I20260929 22:48:13.397498 25828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.389191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51042 (local address 127.12.27.190:41275)
0929 22:48:13.389252 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.389254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.389500 (+ 246us) server_negotiation.cc:407] Connection header received
0929 22:48:13.389973 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.389974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.389986 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.390034 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.390643 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.391140 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.392208 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.392453 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.392542 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.394613 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.394615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.394615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.394622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.396014 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.396512 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.396513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.396514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.396577 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.396853 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.396854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.396854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.396972 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.397048 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.397317 (+ 269us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.397399 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:48:13.397676 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.389170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41275 (local address 127.0.0.1:51042)
0929 22:48:13.389335 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.389418 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.389868 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.390101 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.390104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.390352 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.390542 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.390546 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.391227 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.391228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.392091 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.392099 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.392550 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.392552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.392673 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.393172 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.393180 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.394510 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.396111 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.396118 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.396121 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.396428 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.396652 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.396653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.396653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.396767 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.397053 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.397060 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.397191 (+ 131us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.397295 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.397445 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260929 22:48:13.398223 25975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:48:13.404712 25979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.396705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44288 (local address 127.12.27.188:44295)
0929 22:48:13.396917 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.396922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.396943 (+ 21us) server_negotiation.cc:407] Connection header received
0929 22:48:13.396991 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.396994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.397007 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.397077 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.397623 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.398570 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.399289 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.399605 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.399714 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.401938 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.401946 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.401946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.401953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.403512 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.403916 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.403918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.403919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.403970 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.404164 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.404165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.404165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.404327 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.404484 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.404558 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.404638 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":69,"threads_started":1}
I20260929 22:48:13.405108 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.398481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:46019 (local address 127.0.0.1:56808)
0929 22:48:13.398526 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.398536 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.398573 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.398730 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.398731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.398845 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.398888 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.398889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.399513 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.399514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.400175 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.400177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.400551 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.400552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.400633 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.401025 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.401030 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.402228 (+ 1198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.404081 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.404081 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.404082 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.404284 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.404489 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.404490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.404491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.404557 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.404825 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.404826 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.404866 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.404940 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.405021 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:48:13.405155 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.398547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56808 (local address 127.12.27.189:46019)
0929 22:48:13.398589 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.398591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.398600 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:13.398625 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.398626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.398637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.398688 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.398973 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.399424 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.400259 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.400471 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.400543 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.402304 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.402306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.402306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.402313 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.404010 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.404352 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.404352 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.404353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.404419 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.404627 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.404629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.404629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.404755 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.404828 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.404988 (+ 160us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.405060 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:48:13.405522 25975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:13.411729 25825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } attempt: 2
I20260929 22:48:13.412539 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.405725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44294)
0929 22:48:13.405767 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.405778 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.405815 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.405959 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.405959 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.406065 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.406088 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.406089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.406849 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.406850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.407366 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.407368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.407848 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.407849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.407901 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.408378 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.408382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.409527 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.411159 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.411160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.411160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.411373 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.411612 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.411613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.411614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.411708 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.411973 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.411974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.412180 (+ 206us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.412263 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.412374 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 22:48:13.412552 25979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.405772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44294 (local address 127.12.27.188:44295)
0929 22:48:13.405802 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.405804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.405811 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:48:13.405876 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.405877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.405885 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.405953 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.406156 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.406781 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.407447 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.407763 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.407840 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.409615 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.409617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.409617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.409623 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.411075 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.411500 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.411500 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.411501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.411548 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.411781 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.411781 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.411782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.411907 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.411975 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.412301 (+ 326us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.412432 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":14}
I20260929 22:48:13.413290 25828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.405617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51044 (local address 127.12.27.190:41275)
0929 22:48:13.405773 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.405775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.405784 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:13.405805 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.405806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.405815 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.405861 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.406417 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.406877 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.407522 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.407747 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.407797 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.410155 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.410156 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.410157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.410163 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.411931 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.412328 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.412330 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.412330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.412400 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.412623 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.412624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.412624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.412760 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.412944 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.413136 (+ 192us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.413206 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260929 22:48:13.414816 25975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: Bootstrap starting.
I20260929 22:48:13.415434 25975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:13.415809 25975 log.cc:824] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: Log is configured to *not* fsync() on all Append() calls
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:48:13.416657 25975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: No bootstrap required, opened a new log
I20260929 22:48:13.418749 25975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.418892 25975 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:13.418926 25975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e4228dc8b344468c68a5adc21cb109, State: Initialized, Role: FOLLOWER
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:48:13.419200 25975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.419495 25980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.412057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44308 (local address 127.12.27.188:44295)
0929 22:48:13.412212 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.412213 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.412219 (+ 6us) server_negotiation.cc:407] Connection header received
0929 22:48:13.412233 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.412233 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.412255 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.412654 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.412696 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.413377 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.414107 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.414388 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.414686 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.416465 (+ 1779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.416466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.416466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.416472 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.418171 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.418720 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.418721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.418721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.418777 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.418968 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.418969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.418969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.419109 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.419174 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.419325 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.419392 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
I20260929 22:48:13.419582 25827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.411965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44308)
0929 22:48:13.412043 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.412057 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.412085 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.412362 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.412363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.412541 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.412580 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.412582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.413482 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.413483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.414031 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.414033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.414486 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.414487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.414548 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.414904 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.414909 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.416369 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.418412 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.418414 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.418415 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.418632 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.418845 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.418845 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.418846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.418901 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.419168 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.419169 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.419211 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.419301 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.419386 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260929 22:48:13.419668 25975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:13.419754 25982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.420140 25982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:48:13.421752 25825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f: Bootstrap starting.
W20260929 22:48:13.422014 25993 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:48:13.422056 25993 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:48:13.422506 25825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:13.422832 25825 log.cc:824] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:13.422906 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.414450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56816 (local address 127.12.27.189:46019)
0929 22:48:13.414494 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.414495 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.414534 (+ 39us) server_negotiation.cc:407] Connection header received
0929 22:48:13.414595 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.414595 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.414604 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.414663 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.415487 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.416117 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.416837 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.417094 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.417182 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.419564 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.419565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.419566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.419572 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.421639 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.422099 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.422100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.422100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.422159 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.422340 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.422341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.422341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.422452 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.422649 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.422686 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.422755 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:48:13.423843 25825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f: No bootstrap required, opened a new log
I20260929 22:48:13.422292 25907 master_runner.cc:186] Error getting master registration for 127.12.27.190:41275: OK, instance_id { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" instance_seqno: 1790722093068264 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:48:13.425211 25907 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:48:13.425324 25825 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.425439 25825 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:13.425462 25825 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f18d4cb3cac4fac94eaa1d4507d4c7f, State: Initialized, Role: FOLLOWER
I20260929 22:48:13.425580 25825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.425814 25996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.425872 25825 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:13.425889 25996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:48:13.427542 26007 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:48:13.427668 26007 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:48:13.428125 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:48:13.428323 25757 master_runner.cc:186] Error getting master registration for 127.12.27.189:46019: OK, instance_id { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" instance_seqno: 1790722093221274 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:48:13.431671 25757 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:48:13.437646 25828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.429603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51050 (local address 127.12.27.190:41275)
0929 22:48:13.429648 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.429650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.430106 (+ 456us) server_negotiation.cc:407] Connection header received
0929 22:48:13.430217 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.430218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.430228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.430257 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.431023 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.431732 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.432780 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.433057 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.433100 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.434645 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.434646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.434646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.434653 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.436297 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.436814 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.436815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.436815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.436868 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.437069 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.437070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.437070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.437188 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.437267 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.437487 (+ 220us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.437562 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:48:13.445482 25980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.430105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44310 (local address 127.12.27.188:44295)
0929 22:48:13.430138 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.430140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.438188 (+ 8048us) server_negotiation.cc:407] Connection header received
0929 22:48:13.438288 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.438289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.438300 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.438331 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.438962 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.439715 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.440773 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.441118 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.441161 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.442567 (+ 1406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.442568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.442569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.442576 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.444214 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.444608 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.444610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.444610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.444664 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.444859 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.444860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.444860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.444996 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.445075 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.445297 (+ 222us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.445378 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:48:13.445966 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.429883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56824 (local address 127.12.27.189:46019)
0929 22:48:13.429935 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.429937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.438038 (+ 8101us) server_negotiation.cc:407] Connection header received
0929 22:48:13.438135 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.438136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.438146 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.438174 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.438816 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.439548 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.440553 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.440841 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.440880 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.442631 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.442632 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.442632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.442639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.444781 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.445163 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.445164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.445164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.445215 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.445417 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.445417 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.445418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.445535 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.445607 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.445805 (+ 198us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.445879 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:48:13.457262 25900 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } attempt: 3
Sep 29 22:48:13 dist-test-slave-00d6 krb5kdc[25744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:48:13.465344 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.457516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44295 (local address 127.0.0.1:44326)
0929 22:48:13.457566 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:13.457576 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:13.457611 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:13.457789 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:13.457790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:13.457953 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:13.457995 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.457997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.458894 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.458894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.459735 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:13.459737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.460190 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.460191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:13.460262 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.460766 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:13.460771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:13.462421 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:13.464273 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.464274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.464275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.464495 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.464703 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:13.464704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:13.464705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:13.464769 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:13.465031 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:13.465031 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:13.465076 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 22:48:13.465154 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:48:13.465242 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:48:13.465368 25980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:13.457575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44326 (local address 127.12.27.188:44295)
0929 22:48:13.457611 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:13.457613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:13.457621 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:48:13.457675 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:13.457676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:13.457685 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:13.457744 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:13.458076 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.458807 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.459812 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:13.460104 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:13.460178 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:13.462515 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:13.462516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:13.462517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:13.462523 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:13.464188 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.464572 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.464573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.464574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.464634 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:13.464835 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:13.464836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:13.464836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:13.464963 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:13.465035 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:13.465205 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 22:48:13.465276 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:48:13.467358 25900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: Bootstrap starting.
I20260929 22:48:13.468122 25900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:13.468452 25900 log.cc:824] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:13.469429 25900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: No bootstrap required, opened a new log
I20260929 22:48:13.471396 25900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.471544 25900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:13.471580 25900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62baf9d27e7c44e19fd3a9a080a1a5fc, State: Initialized, Role: FOLLOWER
I20260929 22:48:13.471767 25900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.472076 25900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:13.472036 26017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.472230 26017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:48:13.473881 26028 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:48:13.473981 26028 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:48:13.476467 25832 master_runner.cc:263] No leader master found from master 62baf9d27e7c44e19fd3a9a080a1a5fc
I20260929 22:48:13.476513 25832 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:48:13.499966 25996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:13.500090 25996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.500293 25996 leader_election.cc:288] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62baf9d27e7c44e19fd3a9a080a1a5fc (127.12.27.189:46019), 20e4228dc8b344468c68a5adc21cb109 (127.12.27.188:44295)
I20260929 22:48:13.500762 25874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" is_pre_election: true
I20260929 22:48:13.500911 25874 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f18d4cb3cac4fac94eaa1d4507d4c7f in term 0.
I20260929 22:48:13.501132 25775 leader_election.cc:302] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f18d4cb3cac4fac94eaa1d4507d4c7f, 62baf9d27e7c44e19fd3a9a080a1a5fc; no voters:
I20260929 22:48:13.501591 25949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e4228dc8b344468c68a5adc21cb109" is_pre_election: true
I20260929 22:48:13.501724 25949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f18d4cb3cac4fac94eaa1d4507d4c7f in term 0.
I20260929 22:48:13.502033 25996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:48:13.502095 25996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:48:13.502136 25996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:13.503014 25996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.503134 25996 leader_election.cc:288] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [CANDIDATE]: Term 1 election: Requested vote from peers 62baf9d27e7c44e19fd3a9a080a1a5fc (127.12.27.189:46019), 20e4228dc8b344468c68a5adc21cb109 (127.12.27.188:44295)
I20260929 22:48:13.503502 25874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc"
I20260929 22:48:13.503575 25874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:13.504550 25874 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f18d4cb3cac4fac94eaa1d4507d4c7f in term 1.
I20260929 22:48:13.504733 25775 leader_election.cc:302] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f18d4cb3cac4fac94eaa1d4507d4c7f, 62baf9d27e7c44e19fd3a9a080a1a5fc; no voters:
I20260929 22:48:13.504873 25949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e4228dc8b344468c68a5adc21cb109"
I20260929 22:48:13.504945 25949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:13.505801 25949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f18d4cb3cac4fac94eaa1d4507d4c7f in term 1.
I20260929 22:48:13.506052 25996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:13.506222 25996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [term 1 LEADER]: Becoming Leader. State: Replica: 1f18d4cb3cac4fac94eaa1d4507d4c7f, State: Running, Role: LEADER
I20260929 22:48:13.506310 25996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } }
I20260929 22:48:13.506709 25996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f18d4cb3cac4fac94eaa1d4507d4c7f. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.506778 25996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:13.507129 26032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:13.507380 26032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:13.510249 25949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [term 1 FOLLOWER]: Refusing update from remote peer 1f18d4cb3cac4fac94eaa1d4507d4c7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:13.510640 25996 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:13.511960 25982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f18d4cb3cac4fac94eaa1d4507d4c7f. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.512066 25982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:48:13.512530 25874 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [term 1 FOLLOWER]: Refusing update from remote peer 1f18d4cb3cac4fac94eaa1d4507d4c7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:13.512837 25996 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:13.514012 26017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f18d4cb3cac4fac94eaa1d4507d4c7f. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.514096 26017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:48:13.515422 26030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.515503 26030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:13.516026 26017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.516103 26017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:48:13.516345 26033 mvcc.cc:205] Tried to move back new op lower bound from 7334797695015743488 to 7334797695002390528. Current Snapshot: MvccSnapshot[applied={T|T < 7334797695015743488}]
I20260929 22:48:13.516575 26036 mvcc.cc:205] Tried to move back new op lower bound from 7334797695015743488 to 7334797695002390528. Current Snapshot: MvccSnapshot[applied={T|T < 7334797695015743488}]
I20260929 22:48:13.517343 25996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.517493 25996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:13.517875 25982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f18d4cb3cac4fac94eaa1d4507d4c7f" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41275 } } peers { permanent_uuid: "62baf9d27e7c44e19fd3a9a080a1a5fc" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 46019 } } peers { permanent_uuid: "20e4228dc8b344468c68a5adc21cb109" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44295 } } }
I20260929 22:48:13.517956 25982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:48:13.518779 26034 mvcc.cc:205] Tried to move back new op lower bound from 7334797695015743488 to 7334797695002390528. Current Snapshot: MvccSnapshot[applied={T|T < 7334797695015743488}]
I20260929 22:48:13.519369 26032 catalog_manager.cc:1347] Generated new cluster ID: 5458181be2f74bb0809ffe858ce292fb
I20260929 22:48:13.519430 26032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:48:13.532276 26032 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:48:13.533077 26032 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:13.546873 26032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f18d4cb3cac4fac94eaa1d4507d4c7f: Generated new TSK 0
I20260929 22:48:13.547159 26032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:48:14.422521 25993 catalog_manager.cc:1259] Loaded cluster ID: 5458181be2f74bb0809ffe858ce292fb
I20260929 22:48:14.422600 25993 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: loading cluster ID for follower catalog manager: success
I20260929 22:48:14.423458 25993 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: acquiring CA information for follower catalog manager: success
I20260929 22:48:14.423791 25993 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 20e4228dc8b344468c68a5adc21cb109: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:48:14.474443 26028 catalog_manager.cc:1259] Loaded cluster ID: 5458181be2f74bb0809ffe858ce292fb
I20260929 22:48:14.474524 26028 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: loading cluster ID for follower catalog manager: success
I20260929 22:48:14.475301 26028 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: acquiring CA information for follower catalog manager: success
I20260929 22:48:14.475564 26028 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 62baf9d27e7c44e19fd3a9a080a1a5fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:48:14.602914 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25757
I20260929 22:48:14.608161 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25832
I20260929 22:48:14.612785 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 25907
2026-09-29T22:48:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2824 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:48:14 dist-test-slave-00d6 krb5kdc[26048](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:48:14 dist-test-slave-00d6 krb5kdc[26048](info): set up 2 sockets
Sep 29 22:48:14 dist-test-slave-00d6 krb5kdc[26048](info): commencing operation
krb5kdc: starting...
W20260929 22:48:15.652262 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:48:15 dist-test-slave-00d6 krb5kdc[26048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:48:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:48:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:48:15.766448 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:35621
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:35621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:15.846975 26061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:15.847175 26061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:15.847199 26061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:15.848398 26061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:15.848441 26061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:15.848456 26061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:15.848497 26061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:15.848515 26061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:15.849973 26061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:35621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:35621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:15.850222 26061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:15.850443 26061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:15.855180 26069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:15.855252 26061 server_base.cc:1034] running on GCE node
W20260929 22:48:15.855165 26066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:15.855154 26067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:15.855633 26061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:15.855949 26061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:15.857105 26061 hybrid_clock.cc:648] HybridClock initialized: now 1790722095857100 us; error 33 us; skew 500 ppm
Sep 29 22:48:15 dist-test-slave-00d6 krb5kdc[26048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722095, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:15.859527 26061 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:15.859961 26061 webserver.cc:460] Webserver started at http://127.12.27.190:34849/ using document root <none> and password file <none>
I20260929 22:48:15.860149 26061 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:15.860188 26061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:15.860291 26061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:15.861276 26061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "2df80e062cbb4b24bc9338e58863c908"
format_stamp: "Formatted at 2026-09-29 22:48:15 on dist-test-slave-00d6"
server_key: "26645343e041b32cb0df88cfa99e8ab5"
server_key_iv: "b3f5ddadb2eac7ed147fdb3dcc211d2b"
server_key_version: "encryptionkey@0"
I20260929 22:48:15.861573 26061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "2df80e062cbb4b24bc9338e58863c908"
format_stamp: "Formatted at 2026-09-29 22:48:15 on dist-test-slave-00d6"
server_key: "26645343e041b32cb0df88cfa99e8ab5"
server_key_iv: "b3f5ddadb2eac7ed147fdb3dcc211d2b"
server_key_version: "encryptionkey@0"
I20260929 22:48:15.862772 26061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:48:15.863425 26076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:15.863606 26061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:48:15.863729 26061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "2df80e062cbb4b24bc9338e58863c908"
format_stamp: "Formatted at 2026-09-29 22:48:15 on dist-test-slave-00d6"
server_key: "26645343e041b32cb0df88cfa99e8ab5"
server_key_iv: "b3f5ddadb2eac7ed147fdb3dcc211d2b"
server_key_version: "encryptionkey@0"
I20260929 22:48:15.863803 26061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:15.878321 26061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:15.880168 26061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:15.880314 26061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:15.884096 26061 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:35621
I20260929 22:48:15.884135 26128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:35621 every 8 connection(s)
I20260929 22:48:15.884473 26061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:15.885280 26129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:15.887439 26129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908: Bootstrap starting.
I20260929 22:48:15.888036 26129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:15.888321 26129 log.cc:824] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:15.888983 26129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908: No bootstrap required, opened a new log
I20260929 22:48:15.890520 26129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df80e062cbb4b24bc9338e58863c908" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35621 } }
I20260929 22:48:15.890650 26129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:15.890672 26129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df80e062cbb4b24bc9338e58863c908, State: Initialized, Role: FOLLOWER
I20260929 22:48:15.890859 26129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df80e062cbb4b24bc9338e58863c908" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35621 } }
I20260929 22:48:15.890919 26129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:15.890938 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26061
I20260929 22:48:15.890977 26129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:15.891031 26129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:15.891048 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:48:15.891237 12398 external_mini_cluster.cc:1428] Setting key 0c4e7969ca6b99069af5a2e583b4a09f
I20260929 22:48:15.891749 26129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df80e062cbb4b24bc9338e58863c908" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35621 } }
I20260929 22:48:15.891914 26129 leader_election.cc:302] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2df80e062cbb4b24bc9338e58863c908; no voters:
I20260929 22:48:15.892089 26129 leader_election.cc:288] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:48:15.892122 26134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:15.892295 26134 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [term 1 LEADER]: Becoming Leader. State: Replica: 2df80e062cbb4b24bc9338e58863c908, State: Running, Role: LEADER
I20260929 22:48:15.892326 26129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:15.892438 26134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df80e062cbb4b24bc9338e58863c908" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35621 } }
I20260929 22:48:15.892917 26135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2df80e062cbb4b24bc9338e58863c908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df80e062cbb4b24bc9338e58863c908" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35621 } } }
I20260929 22:48:15.893011 26135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:15.893312 26136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2df80e062cbb4b24bc9338e58863c908. Latest consensus state: current_term: 1 leader_uuid: "2df80e062cbb4b24bc9338e58863c908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df80e062cbb4b24bc9338e58863c908" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 35621 } } }
I20260929 22:48:15.893393 26136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908 [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:15.893592 26142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:15.894126 26142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:15.895898 26142 catalog_manager.cc:1347] Generated new cluster ID: 9ad0e99cf6224daa8af1f0d3114a58dd
I20260929 22:48:15.895952 26142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:48:15 dist-test-slave-00d6 krb5kdc[26048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:15.902908 26133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:15.891691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46806 (local address 127.12.27.190:35621)
0929 22:48:15.891871 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:15.891880 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:15.891944 (+ 64us) server_negotiation.cc:407] Connection header received
0929 22:48:15.892064 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:15.892072 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:15.892130 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:15.892269 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:15.893239 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:15.894714 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:15.895738 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:15.896330 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:15.896428 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:15.899182 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:15.899186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:15.899186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:15.899197 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:15.901163 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:15.901586 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:15.901590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:15.901590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:15.901702 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:15.901910 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:15.901910 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:15.901911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:15.902190 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:15.902329 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:15.902464 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 22:48:15.902694 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260929 22:48:15.903898 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:48:15.915454 26142 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:48:15.916136 26142 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:15.925410 26142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2df80e062cbb4b24bc9338e58863c908: Generated new TSK 0
I20260929 22:48:15.925619 26142 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:48:15.957907 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26061
2026-09-29T22:48:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1343 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:48:16 dist-test-slave-00d6 krb5kdc[26157](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:48:16 dist-test-slave-00d6 krb5kdc[26157](info): set up 2 sockets
Sep 29 22:48:16 dist-test-slave-00d6 krb5kdc[26157](info): commencing operation
krb5kdc: starting...
W20260929 22:48:16.992192 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:48:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:48:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:48:17.110092 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41203
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:41203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:17.191980 26170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:17.192173 26170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:17.192195 26170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:17.193331 26170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:17.193377 26170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:17.193391 26170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:17.193404 26170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:17.193439 26170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:17.194877 26170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:41203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:17.195128 26170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:17.195351 26170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:17.200124 26178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.200176 26170 server_base.cc:1034] running on GCE node
W20260929 22:48:17.200126 26176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:17.200174 26175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.200650 26170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:17.200937 26170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:17.202127 26170 hybrid_clock.cc:648] HybridClock initialized: now 1790722097202067 us; error 101 us; skew 500 ppm
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:17.208446 26170 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:17.208906 26170 webserver.cc:460] Webserver started at http://127.12.27.190:35789/ using document root <none> and password file <none>
I20260929 22:48:17.209152 26170 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:17.209218 26170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:17.209357 26170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:17.210381 26170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "1e720ca479ae43e98e50ee735ee4199b"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "e81fdcce8ed404e57d84ff622cc8ccf9"
server_key_iv: "5ff1416c056152a3d3465c450a54e6f9"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.210734 26170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "1e720ca479ae43e98e50ee735ee4199b"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "e81fdcce8ed404e57d84ff622cc8ccf9"
server_key_iv: "5ff1416c056152a3d3465c450a54e6f9"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.212098 26170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:48:17.212839 26185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.213011 26170 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:48:17.213143 26170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1e720ca479ae43e98e50ee735ee4199b"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "e81fdcce8ed404e57d84ff622cc8ccf9"
server_key_iv: "5ff1416c056152a3d3465c450a54e6f9"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.213215 26170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:17.245936 26170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:17.248469 26170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:17.248647 26170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:17.252564 26170 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:41203
I20260929 22:48:17.252627 26237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:41203 every 8 connection(s)
I20260929 22:48:17.252969 26170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:17.253930 26238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:17.254766 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26170
I20260929 22:48:17.254854 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:48:17.255036 12398 external_mini_cluster.cc:1428] Setting key c235f6e4a4fe2ecf57aed54806e2e6d3
I20260929 22:48:17.256506 26238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap starting.
I20260929 22:48:17.257241 26238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:17.257540 26238 log.cc:824] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:17.258173 26238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: No bootstrap required, opened a new log
I20260929 22:48:17.260103 26238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:17.260269 26238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:17.260319 26238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e720ca479ae43e98e50ee735ee4199b, State: Initialized, Role: FOLLOWER
I20260929 22:48:17.260447 26238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:17.260538 26238 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:17.260582 26238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:17.260630 26238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:17.261179 26238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:17.261294 26238 leader_election.cc:302] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e720ca479ae43e98e50ee735ee4199b; no voters:
I20260929 22:48:17.261468 26238 leader_election.cc:288] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:48:17.261498 26243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:17.261662 26243 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 LEADER]: Becoming Leader. State: Replica: 1e720ca479ae43e98e50ee735ee4199b, State: Running, Role: LEADER
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:17.261807 26243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:17.261708 26238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:17.262312 26245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e720ca479ae43e98e50ee735ee4199b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } } }
I20260929 22:48:17.262460 26245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:17.262516 26244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e720ca479ae43e98e50ee735ee4199b. Latest consensus state: current_term: 1 leader_uuid: "1e720ca479ae43e98e50ee735ee4199b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } } }
I20260929 22:48:17.262663 26244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:17.262740 26249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:17.263267 26249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:17.266433 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.255590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.12.27.190:41203)
0929 22:48:17.255789 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.255797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.255821 (+ 24us) server_negotiation.cc:407] Connection header received
0929 22:48:17.256321 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.256327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.256372 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.256486 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:17.257261 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.258244 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.259015 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.259428 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.259542 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.262291 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:17.262296 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:17.262296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:17.262310 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:17.264646 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.265054 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.265057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.265057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.265169 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.265386 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.265387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.265388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.265767 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:17.265929 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.266034 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.266183 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":117,"threads_started":1}
I20260929 22:48:17.266835 26249 catalog_manager.cc:1347] Generated new cluster ID: 7f188fbcf7e547cca705f46112f19230
I20260929 22:48:17.266904 26249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:48:17.276885 26249 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:48:17.277475 26249 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:17.286367 26249 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Generated new TSK 0
I20260929 22:48:17.286612 26249 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:48:17.322943 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:41203
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:17.405498 26264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:17.405697 26264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:17.405722 26264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:17.406999 26264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:17.407048 26264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:17.407076 26264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:17.408591 26264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:17.408835 26264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:17.409053 26264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:17.414006 26270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:17.414050 26269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.414235 26264 server_base.cc:1034] running on GCE node
W20260929 22:48:17.414005 26272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.414564 26264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:17.414803 26264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:17.415961 26264 hybrid_clock.cc:648] HybridClock initialized: now 1790722097415952 us; error 34 us; skew 500 ppm
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:17.418437 26264 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:17.418845 26264 webserver.cc:460] Webserver started at http://127.12.27.129:45501/ using document root <none> and password file <none>
I20260929 22:48:17.419064 26264 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:17.419135 26264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:17.419277 26264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:17.420344 26264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "9d47c39957214c08827484c6820071fd"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "43aec8ec4e637a9f4ae86682821663f8"
server_key_iv: "a4f45957ac2f487a383c16c84b5f76e4"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.420696 26264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "9d47c39957214c08827484c6820071fd"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "43aec8ec4e637a9f4ae86682821663f8"
server_key_iv: "a4f45957ac2f487a383c16c84b5f76e4"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.422125 26264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:48:17.422850 26279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.423040 26264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:17.423153 26264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "9d47c39957214c08827484c6820071fd"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "43aec8ec4e637a9f4ae86682821663f8"
server_key_iv: "a4f45957ac2f487a383c16c84b5f76e4"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.423224 26264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:17.437592 26264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:17.439479 26264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:17.439697 26264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:17.439924 26264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:17.440238 26264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:17.440295 26264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.440336 26264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:17.440363 26264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.446034 26264 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:32785
I20260929 22:48:17.446076 26392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:32785 every 8 connection(s)
I20260929 22:48:17.446406 26264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:17.447556 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26264
I20260929 22:48:17.447681 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:48:17.447896 12398 external_mini_cluster.cc:1428] Setting key 6984e2c6644950b560c24ca8a83c49d2
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:48:17.456323 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.447116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:33653 (local address 127.12.27.190:41203)
0929 22:48:17.447166 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.447169 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.447370 (+ 201us) server_negotiation.cc:407] Connection header received
0929 22:48:17.448038 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.448039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.448052 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.448110 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:17.449141 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.449651 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.450641 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.450864 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.450948 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.453500 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:17.453501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:17.453502 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:17.453510 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:17.454891 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.455311 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.455313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.455313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.455376 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.455620 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.455620 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.455621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.455765 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:17.455839 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.456140 (+ 301us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.456233 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:48:17.456502 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.447102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:33653)
0929 22:48:17.447257 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:17.447292 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:17.447899 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:17.448182 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:17.448186 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:17.448840 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:17.449024 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.449028 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.449756 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.449757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.450542 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.450544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.450960 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.450961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.451088 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.451596 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:17.451604 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:17.453405 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:17.454989 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:17.454997 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:17.454999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:17.455225 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:17.455441 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:17.455442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:17.455442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:17.455552 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:17.455831 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:17.455838 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:17.455991 (+ 153us) client_negotiation.cc:769] Sending connection context
0929 22:48:17.456121 (+ 130us) client_negotiation.cc:240] Negotiation successful
0929 22:48:17.456270 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":95,"threads_started":1}
I20260929 22:48:17.456969 26393 heartbeater.cc:347] Connected to a master server at 127.12.27.190:41203
I20260929 22:48:17.457083 26393 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:17.457239 26393 heartbeater.cc:511] Master 127.12.27.190:41203 requested a full tablet report, sending...
I20260929 22:48:17.457705 26202 ts_manager.cc:194] Registered new tserver with Master: 9d47c39957214c08827484c6820071fd (127.12.27.129:32785)
I20260929 22:48:17.458379 26202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:33653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:48:17.475118 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:41203
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:17.557102 26398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:17.557301 26398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:17.557324 26398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:17.558460 26398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:17.558502 26398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:17.558529 26398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:17.560079 26398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:17.560325 26398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:17.560552 26398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:17.565838 26406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:17.565846 26404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.565976 26398 server_base.cc:1034] running on GCE node
W20260929 22:48:17.565847 26403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.566280 26398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:17.566527 26398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:17.567689 26398 hybrid_clock.cc:648] HybridClock initialized: now 1790722097567676 us; error 28 us; skew 500 ppm
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:17.570245 26398 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:17.570627 26398 webserver.cc:460] Webserver started at http://127.12.27.130:36975/ using document root <none> and password file <none>
I20260929 22:48:17.570801 26398 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:17.570840 26398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:17.570926 26398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:17.571992 26398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "b3cbcb809a0d49d082d49869383a589a"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "fd4191eda44dcfcbed22fe5700a27daa"
server_key_iv: "3fbf21504b52997963ef5fee9a1d5939"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.572299 26398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "b3cbcb809a0d49d082d49869383a589a"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "fd4191eda44dcfcbed22fe5700a27daa"
server_key_iv: "3fbf21504b52997963ef5fee9a1d5939"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.573552 26398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:48:17.574270 26413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.574438 26398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:17.574534 26398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "b3cbcb809a0d49d082d49869383a589a"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "fd4191eda44dcfcbed22fe5700a27daa"
server_key_iv: "3fbf21504b52997963ef5fee9a1d5939"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.574626 26398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:17.591010 26398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:17.593034 26398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:17.593202 26398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:17.593446 26398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:17.593773 26398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:17.593824 26398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.593861 26398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:17.593888 26398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.599718 26398 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:38245
I20260929 22:48:17.599767 26526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:38245 every 8 connection(s)
I20260929 22:48:17.600097 26398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:17.609010 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.600765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:43057 (local address 127.12.27.190:41203)
0929 22:48:17.600808 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.600810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.601028 (+ 218us) server_negotiation.cc:407] Connection header received
0929 22:48:17.601528 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.601530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.601541 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.601598 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:17.602489 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.602983 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.604021 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.604210 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.604270 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.606267 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:17.606269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:17.606269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:17.606275 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:17.607739 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.608152 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.608153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.608153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.608211 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.608449 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.608450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.608450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.608568 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:17.608636 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.608866 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.608945 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:48:17.609129 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.600763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:43057)
0929 22:48:17.600911 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:17.600943 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:17.601412 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:17.601650 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:17.601654 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:17.602215 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:17.602407 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.602411 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.603064 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.603065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.603942 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.603945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.604286 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.604287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.604382 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.604830 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:17.604838 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:17.606153 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:17.607811 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:17.607816 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:17.607818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:17.608068 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:17.608274 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:17.608275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:17.608275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:17.608372 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:17.608634 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:17.608638 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:17.608745 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 22:48:17.608826 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:48:17.608942 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":90,"threads_started":1}
I20260929 22:48:17.609611 26527 heartbeater.cc:347] Connected to a master server at 127.12.27.190:41203
I20260929 22:48:17.609720 26527 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:17.609916 26527 heartbeater.cc:511] Master 127.12.27.190:41203 requested a full tablet report, sending...
I20260929 22:48:17.610100 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26398
I20260929 22:48:17.610214 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:48:17.610355 26202 ts_manager.cc:194] Registered new tserver with Master: b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
I20260929 22:48:17.610463 12398 external_mini_cluster.cc:1428] Setting key d76bbbc78e67e5e1c708d47d2a885780
I20260929 22:48:17.610848 26202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:43057
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:48:17.634589 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:41203
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:17.715375 26532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:17.715664 26532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:17.715703 26532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:17.716951 26532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:17.716995 26532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:17.717022 26532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:17.718420 26532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:17.718650 26532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:17.718822 26532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:17.723716 26537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:17.723730 26538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:17.723734 26540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:17.723898 26532 server_base.cc:1034] running on GCE node
I20260929 22:48:17.724128 26532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:17.724364 26532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:17.725525 26532 hybrid_clock.cc:648] HybridClock initialized: now 1790722097725508 us; error 38 us; skew 500 ppm
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:17.728058 26532 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:17.728449 26532 webserver.cc:460] Webserver started at http://127.12.27.131:38465/ using document root <none> and password file <none>
I20260929 22:48:17.728643 26532 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:17.728716 26532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:17.728848 26532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:17.729887 26532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "d229de32c5ff473f983900f9945db570"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "074434b8d804d4599dc4a18860c29709"
server_key_iv: "52d9f1962bd2501bf471a97195350347"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.730247 26532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "d229de32c5ff473f983900f9945db570"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "074434b8d804d4599dc4a18860c29709"
server_key_iv: "52d9f1962bd2501bf471a97195350347"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.731715 26532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:48:17.732558 26547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.732744 26532 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:17.732842 26532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "d229de32c5ff473f983900f9945db570"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "074434b8d804d4599dc4a18860c29709"
server_key_iv: "52d9f1962bd2501bf471a97195350347"
server_key_version: "encryptionkey@0"
I20260929 22:48:17.732928 26532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:17.743875 26532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:17.745865 26532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:17.746023 26532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:17.746243 26532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:17.746541 26532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:17.746592 26532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.746631 26532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:17.746657 26532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:17.752681 26532 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38977
I20260929 22:48:17.752722 26660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38977 every 8 connection(s)
I20260929 22:48:17.753051 26532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:48:17 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722097, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:17.759204 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26532
I20260929 22:48:17.759302 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:48:17.759519 12398 external_mini_cluster.cc:1428] Setting key 2d6e1e92f22efe73b7ee8ba24ae8bd23
I20260929 22:48:17.762307 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.753789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:59869 (local address 127.12.27.190:41203)
0929 22:48:17.753863 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.753866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.754043 (+ 177us) server_negotiation.cc:407] Connection header received
0929 22:48:17.754595 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.754596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.754609 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.754668 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:17.755684 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.756185 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.757172 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.757355 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.757442 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.759749 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:17.759750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:17.759750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:17.759757 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:17.761128 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.761510 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.761511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.761511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.761560 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.761745 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.761745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.761745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.761835 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:17.761880 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.762140 (+ 260us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.762217 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 22:48:17.762511 26663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.753746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:59869)
0929 22:48:17.753932 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:17.753967 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:17.754488 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:17.754734 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:17.754738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:17.755349 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:17.755553 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.755559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.756287 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.756288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.757069 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.757071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.757453 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.757454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.757577 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.758082 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:17.758089 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:17.759630 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:17.761198 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:17.761204 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:17.761206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:17.761420 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:17.761604 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:17.761604 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:17.761605 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:17.761699 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:17.761899 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:17.761904 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:17.762009 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 22:48:17.762116 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 22:48:17.762267 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260929 22:48:17.762977 26661 heartbeater.cc:347] Connected to a master server at 127.12.27.190:41203
I20260929 22:48:17.763088 26661 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:17.763262 26661 heartbeater.cc:511] Master 127.12.27.190:41203 requested a full tablet report, sending...
I20260929 22:48:17.763598 26201 ts_manager.cc:194] Registered new tserver with Master: d229de32c5ff473f983900f9945db570 (127.12.27.131:38977)
I20260929 22:48:17.764050 26201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:59869
I20260929 22:48:17.771239 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:48:17.778759 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.772657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.12.27.190:41203)
0929 22:48:17.772759 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.772762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.772858 (+ 96us) server_negotiation.cc:407] Connection header received
0929 22:48:17.772943 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.772944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.772954 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.773019 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:17.773585 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.774091 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.774877 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.775068 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.775150 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.776329 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:17.776330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:17.776330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:17.776337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:17.777623 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.777965 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.777966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.777967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.778025 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:17.778222 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:17.778223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:17.778223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:17.778366 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:17.778472 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.778583 (+ 111us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.778654 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260929 22:48:17.780306 26201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:48:17.781951 26201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:48:17.788162 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.784114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38977 (local address 127.0.0.1:52690)
0929 22:48:17.784372 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:17.784413 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:17.784490 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:17.784673 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:17.784676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:17.784678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:17.784746 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.784748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.785774 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.785775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.786931 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.786934 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.787855 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.787856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.787935 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.787951 (+ 16us) client_negotiation.cc:769] Sending connection context
0929 22:48:17.788018 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:48:17.788075 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260929 22:48:17.788296 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.784353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49070 (local address 127.12.27.129:32785)
0929 22:48:17.784535 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.784540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.784719 (+ 179us) server_negotiation.cc:407] Connection header received
0929 22:48:17.784767 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.784769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.784785 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.785049 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:17.785121 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.786148 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.787315 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.787929 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.788005 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.788061 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.788153 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.788202 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260929 22:48:17.788267 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.784133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:32785 (local address 127.0.0.1:49070)
0929 22:48:17.784600 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:17.784611 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:17.784656 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:17.785039 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:17.785040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:17.785041 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:17.785068 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.785069 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.786232 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.786233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.787216 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.787219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.788003 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.788004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.788065 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.788070 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:48:17.788141 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 22:48:17.788184 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":9,"thread_start_us":49,"threads_started":1}
I20260929 22:48:17.788667 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.784190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52690 (local address 127.12.27.131:38977)
0929 22:48:17.784363 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.784369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.784469 (+ 100us) server_negotiation.cc:407] Connection header received
0929 22:48:17.784565 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.784567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.784582 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.784837 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:17.784921 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.785674 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.787021 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.787773 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.787850 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.787906 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.788321 (+ 415us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.788576 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
I20260929 22:48:17.788853 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.784133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38245 (local address 127.0.0.1:54246)
0929 22:48:17.784582 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:17.784593 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:17.784665 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:17.784859 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:17.784860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:17.784862 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:17.784917 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.784918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.786182 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.786183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.787295 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:17.787298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.788441 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.788442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:17.788591 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.788595 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:17.788658 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 22:48:17.788695 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":22,"thread_start_us":54,"threads_started":1}
I20260929 22:48:17.789148 26327 tablet_service.cc:1467] Processing CreateTablet for tablet 3420aed867a443c99590bedf6939373f (DEFAULT_TABLE table=test-table [id=d5bddcc809104a5b8c0c2c541eff2537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:17.789333 26595 tablet_service.cc:1467] Processing CreateTablet for tablet 3420aed867a443c99590bedf6939373f (DEFAULT_TABLE table=test-table [id=d5bddcc809104a5b8c0c2c541eff2537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:17.789470 26327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3420aed867a443c99590bedf6939373f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:17.789634 26595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3420aed867a443c99590bedf6939373f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:17.792552 26675 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Bootstrap starting.
I20260929 22:48:17.792579 26676 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Bootstrap starting.
I20260929 22:48:17.792824 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:17.784353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54246 (local address 127.12.27.130:38245)
0929 22:48:17.784535 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:17.784540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:17.784729 (+ 189us) server_negotiation.cc:407] Connection header received
0929 22:48:17.784768 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:17.784770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:17.784785 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:17.784865 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:17.784983 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.786058 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.787361 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:17.788100 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:17.788162 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:17.788209 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:17.788689 (+ 480us) server_negotiation.cc:299] Negotiation successful
0929 22:48:17.788738 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":82,"threads_started":1}
I20260929 22:48:17.793275 26676 tablet_bootstrap.cc:654] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:17.793315 26675 tablet_bootstrap.cc:654] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:17.793804 26676 log.cc:824] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:17.793773 26461 tablet_service.cc:1467] Processing CreateTablet for tablet 3420aed867a443c99590bedf6939373f (DEFAULT_TABLE table=test-table [id=d5bddcc809104a5b8c0c2c541eff2537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:17.793957 26675 log.cc:824] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:17.794134 26461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3420aed867a443c99590bedf6939373f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:17.794523 26676 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: No bootstrap required, opened a new log
I20260929 22:48:17.794593 26676 ts_tablet_manager.cc:1397] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:17.796079 26676 raft_consensus.cc:348] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:17.796216 26676 raft_consensus.cc:374] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:17.796237 26676 raft_consensus.cc:729] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d47c39957214c08827484c6820071fd, State: Initialized, Role: FOLLOWER
I20260929 22:48:17.796360 26676 consensus_queue.cc:260] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:17.796645 26676 ts_tablet_manager.cc:1428] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:17.796682 26393 heartbeater.cc:503] Master 127.12.27.190:41203 was elected leader, sending a full tablet report...
I20260929 22:48:17.797336 26680 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Bootstrap starting.
I20260929 22:48:17.797935 26680 tablet_bootstrap.cc:654] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:17.798331 26675 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: No bootstrap required, opened a new log
I20260929 22:48:17.798421 26675 ts_tablet_manager.cc:1397] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260929 22:48:17.798629 26680 log.cc:824] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:17.799516 26680 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: No bootstrap required, opened a new log
I20260929 22:48:17.799571 26680 ts_tablet_manager.cc:1397] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:17.800129 26675 raft_consensus.cc:348] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:17.800271 26675 raft_consensus.cc:374] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:17.800311 26675 raft_consensus.cc:729] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d229de32c5ff473f983900f9945db570, State: Initialized, Role: FOLLOWER
I20260929 22:48:17.800429 26675 consensus_queue.cc:260] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:17.800684 26675 ts_tablet_manager.cc:1428] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:48:17.800769 26661 heartbeater.cc:503] Master 127.12.27.190:41203 was elected leader, sending a full tablet report...
I20260929 22:48:17.801071 26680 raft_consensus.cc:348] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:17.801231 26680 raft_consensus.cc:374] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:17.801275 26680 raft_consensus.cc:729] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbcb809a0d49d082d49869383a589a, State: Initialized, Role: FOLLOWER
I20260929 22:48:17.801370 26680 consensus_queue.cc:260] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:17.801628 26680 ts_tablet_manager.cc:1428] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:48:17.801640 26527 heartbeater.cc:503] Master 127.12.27.190:41203 was elected leader, sending a full tablet report...
W20260929 22:48:17.850746 26528 tablet.cc:2369] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:48:17.947147 26394 tablet.cc:2369] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:48:18.003746 26662 tablet.cc:2369] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:48:18.026180 26682 raft_consensus.cc:482] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:18.026336 26682 raft_consensus.cc:504] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.026782 26682 leader_election.cc:288] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245), 9d47c39957214c08827484c6820071fd (127.12.27.129:32785)
I20260929 22:48:18.029810 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.027020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:45197 (local address 127.12.27.130:38245)
0929 22:48:18.027126 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.027128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.027139 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:48:18.027173 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.027173 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.027185 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.027253 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.027430 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.027987 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.029024 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.029454 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.029509 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.029516 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.029696 (+ 180us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.029738 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260929 22:48:18.029806 26663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.026977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38245 (local address 127.12.27.131:45197)
0929 22:48:18.027045 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.027057 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.027109 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.027272 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.027273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.027275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.027352 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.027354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.028059 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.028059 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.028943 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.028945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.029538 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.029539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.029626 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.029630 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.029681 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.029720 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260929 22:48:18.029902 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.027100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:58211 (local address 127.12.27.129:32785)
0929 22:48:18.027143 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.027145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.027253 (+ 108us) server_negotiation.cc:407] Connection header received
0929 22:48:18.027287 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.027288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.027297 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.027357 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.027562 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.028093 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.029126 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.029547 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.029626 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.029635 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.029785 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.029827 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:48:18.029938 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.027002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:32785 (local address 127.12.27.131:58211)
0929 22:48:18.027172 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.027182 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.027241 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.027368 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.027369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.027370 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.027489 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.027491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.028171 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.028172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.029043 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.029045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.029629 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.029629 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.029711 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.029715 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.029771 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.029807 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260929 22:48:18.030242 26347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3420aed867a443c99590bedf6939373f" candidate_uuid: "d229de32c5ff473f983900f9945db570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d47c39957214c08827484c6820071fd" is_pre_election: true
I20260929 22:48:18.030328 26481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3420aed867a443c99590bedf6939373f" candidate_uuid: "d229de32c5ff473f983900f9945db570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbcb809a0d49d082d49869383a589a" is_pre_election: true
I20260929 22:48:18.030409 26347 raft_consensus.cc:2454] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d229de32c5ff473f983900f9945db570 in term 0.
I20260929 22:48:18.030464 26481 raft_consensus.cc:2454] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d229de32c5ff473f983900f9945db570 in term 0.
I20260929 22:48:18.030666 26548 leader_election.cc:302] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9d47c39957214c08827484c6820071fd, b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570; no voters:
I20260929 22:48:18.030835 26682 raft_consensus.cc:2781] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:48:18.030874 26682 raft_consensus.cc:482] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:48:18.030889 26682 raft_consensus.cc:3037] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:18.031551 26682 raft_consensus.cc:504] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.031725 26682 leader_election.cc:288] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [CANDIDATE]: Term 1 election: Requested vote from peers b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245), 9d47c39957214c08827484c6820071fd (127.12.27.129:32785)
I20260929 22:48:18.031878 26481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3420aed867a443c99590bedf6939373f" candidate_uuid: "d229de32c5ff473f983900f9945db570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbcb809a0d49d082d49869383a589a"
I20260929 22:48:18.031880 26347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3420aed867a443c99590bedf6939373f" candidate_uuid: "d229de32c5ff473f983900f9945db570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d47c39957214c08827484c6820071fd"
I20260929 22:48:18.031963 26347 raft_consensus.cc:3037] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:18.031963 26481 raft_consensus.cc:3037] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:18.032939 26481 raft_consensus.cc:2454] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d229de32c5ff473f983900f9945db570 in term 1.
I20260929 22:48:18.032938 26347 raft_consensus.cc:2454] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d229de32c5ff473f983900f9945db570 in term 1.
I20260929 22:48:18.033141 26551 leader_election.cc:302] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570; no voters:
I20260929 22:48:18.033233 26682 raft_consensus.cc:2781] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:18.033414 26682 raft_consensus.cc:686] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 1 LEADER]: Becoming Leader. State: Replica: d229de32c5ff473f983900f9945db570, State: Running, Role: LEADER
I20260929 22:48:18.033514 26682 consensus_queue.cc:237] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.034319 26201 catalog_manager.cc:5495] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 reported cstate change: term changed from 0 to 1, leader changed from <none> to d229de32c5ff473f983900f9945db570 (127.12.27.131). New cstate: current_term: 1 leader_uuid: "d229de32c5ff473f983900f9945db570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } health_report { overall_health: UNKNOWN } } }
I20260929 22:48:18.072863 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.070237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52696 (local address 127.12.27.131:38977)
0929 22:48:18.070300 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.070302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.070313 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:48:18.070365 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.070366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.070387 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.070469 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:18.070628 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.071152 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.071994 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.072182 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.072259 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.072436 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:18.072537 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:18.072606 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.072718 (+ 112us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.072735 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:48:18.074843 26481 raft_consensus.cc:1261] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Refusing update from remote peer d229de32c5ff473f983900f9945db570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:18.074836 26347 raft_consensus.cc:1261] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Refusing update from remote peer d229de32c5ff473f983900f9945db570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:18.075199 26685 consensus_queue.cc:1035] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:18.075328 26682 consensus_queue.cc:1035] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:18.077739 26688 mvcc.cc:205] Tried to move back new op lower bound from 7334797713711378432 to 7334797713545822208. Current Snapshot: MvccSnapshot[applied={T|T < 7334797713711378432}]
I20260929 22:48:18.080214 26201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:18.080295 26201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:18.081044 26201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Sending DeleteTablet for 3 replicas of tablet 3420aed867a443c99590bedf6939373f
I20260929 22:48:18.081409 26327 tablet_service.cc:1514] Processing DeleteTablet for tablet 3420aed867a443c99590bedf6939373f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49070
I20260929 22:48:18.081418 26595 tablet_service.cc:1514] Processing DeleteTablet for tablet 3420aed867a443c99590bedf6939373f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:52690
I20260929 22:48:18.081648 26698 tablet_replica.cc:330] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: stopping tablet replica
I20260929 22:48:18.081676 26461 tablet_service.cc:1514] Processing DeleteTablet for tablet 3420aed867a443c99590bedf6939373f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:54246
I20260929 22:48:18.081699 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26264
I20260929 22:48:18.081844 26698 raft_consensus.cc:2229] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:18.082091 26698 raft_consensus.cc:2258] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:18.082264 26699 tablet_replica.cc:330] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: stopping tablet replica
I20260929 22:48:18.082410 26699 raft_consensus.cc:2229] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:18.082512 26699 raft_consensus.cc:2258] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:18.082876 26699 ts_tablet_manager.cc:1905] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:18.084546 26699 ts_tablet_manager.cc:1918] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:18.084627 26699 log.cc:1196] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/3420aed867a443c99590bedf6939373f
I20260929 22:48:18.084867 26699 ts_tablet_manager.cc:1939] T 3420aed867a443c99590bedf6939373f P b3cbcb809a0d49d082d49869383a589a: Deleting consensus metadata
I20260929 22:48:18.085253 26189 catalog_manager.cc:4841] TS b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): tablet 3420aed867a443c99590bedf6939373f (table test-table [id=d5bddcc809104a5b8c0c2c541eff2537]) successfully deleted
I20260929 22:48:18.087755 26697 tablet_replica.cc:330] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: stopping tablet replica
I20260929 22:48:18.087865 26697 raft_consensus.cc:2229] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:48:18.087970 26697 raft_consensus.cc:2258] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:18.088338 26697 ts_tablet_manager.cc:1905] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:48:18.088827 26186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:32785 (error 108)
I20260929 22:48:18.089280 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.089156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:32785 (local address 127.0.0.1:49080)
0929 22:48:18.089204 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.089239 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:32785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 22:48:18.089353 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26398
W20260929 22:48:18.090041 26186 catalog_manager.cc:4584] TS 9d47c39957214c08827484c6820071fd (127.12.27.129:32785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3420aed867a443c99590bedf6939373f: Network error: Client connection negotiation failed: client connection to 127.12.27.129:32785: connect: Connection refused (error 111)
I20260929 22:48:18.090269 26697 ts_tablet_manager.cc:1918] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:18.090359 26697 log.cc:1196] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/3420aed867a443c99590bedf6939373f
I20260929 22:48:18.090619 26697 ts_tablet_manager.cc:1939] T 3420aed867a443c99590bedf6939373f P d229de32c5ff473f983900f9945db570: Deleting consensus metadata
I20260929 22:48:18.091002 26188 catalog_manager.cc:4841] TS d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): tablet 3420aed867a443c99590bedf6939373f (table test-table [id=d5bddcc809104a5b8c0c2c541eff2537]) successfully deleted
I20260929 22:48:18.094907 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26532
I20260929 22:48:18.099012 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26170
I20260929 22:48:18.103890 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41203
--webserver_interface=127.12.27.190
--webserver_port=35789
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:41203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:18.187356 26701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:18.187719 26701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:18.187765 26701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:18.189003 26701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:18.189045 26701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:18.189059 26701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:18.189072 26701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:18.189085 26701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:18.190850 26701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:41203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=35789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:18.191162 26701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:18.191473 26701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:18.201122 26707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.201097 26708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.201261 26701 server_base.cc:1034] running on GCE node
W20260929 22:48:18.201114 26710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.201619 26701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:18.201946 26701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:18.203121 26701 hybrid_clock.cc:648] HybridClock initialized: now 1790722098203099 us; error 41 us; skew 500 ppm
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:18.206456 26701 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:18.206995 26701 webserver.cc:460] Webserver started at http://127.12.27.190:35789/ using document root <none> and password file <none>
I20260929 22:48:18.207253 26701 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:18.207405 26701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:18.208865 26701 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:18.209554 26717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.209726 26701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:18.209834 26701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1e720ca479ae43e98e50ee735ee4199b"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "e81fdcce8ed404e57d84ff622cc8ccf9"
server_key_iv: "5ff1416c056152a3d3465c450a54e6f9"
server_key_version: "encryptionkey@0"
I20260929 22:48:18.210229 26701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:18.220055 26701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:18.222067 26701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:18.222223 26701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:18.226254 26701 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:41203
I20260929 22:48:18.226305 26769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:41203 every 8 connection(s)
I20260929 22:48:18.226698 26701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:18.228413 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26701
I20260929 22:48:18.228550 26770 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:48:18.228755 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:32785
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:41203
--webserver_port=45501
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:18.229379 26770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap starting.
I20260929 22:48:18.238832 26770 log.cc:824] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:18.241129 26770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:18.241477 26770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap complete.
I20260929 22:48:18.244134 26770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.244385 26770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e720ca479ae43e98e50ee735ee4199b, State: Initialized, Role: FOLLOWER
I20260929 22:48:18.244673 26770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.244771 26770 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:18.244810 26770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:18.244918 26770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:48:18.246016 26770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.246104 26770 leader_election.cc:302] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e720ca479ae43e98e50ee735ee4199b; no voters:
I20260929 22:48:18.246316 26770 leader_election.cc:288] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:48:18.246351 26774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:48:18.246469 26774 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 LEADER]: Becoming Leader. State: Replica: 1e720ca479ae43e98e50ee735ee4199b, State: Running, Role: LEADER
I20260929 22:48:18.246569 26774 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.246611 26770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:18.246820 26775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e720ca479ae43e98e50ee735ee4199b. Latest consensus state: current_term: 2 leader_uuid: "1e720ca479ae43e98e50ee735ee4199b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } } }
I20260929 22:48:18.247036 26775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:18.246975 26776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1e720ca479ae43e98e50ee735ee4199b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } } }
I20260929 22:48:18.247288 26776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:18.247447 26782 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:18.248308 26782 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:18.248409 26782 catalog_manager.cc:1259] Loaded cluster ID: 7f188fbcf7e547cca705f46112f19230
I20260929 22:48:18.248436 26782 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:48:18.248651 26782 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260929 22:48:18.253379 26782 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260929 22:48:18.256494 26782 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:18.256717 26782 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Loaded TSK: 0
I20260929 22:48:18.256947 26782 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:48:18.315362 26772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:18.315586 26772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:18.315622 26772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:18.316896 26772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:18.316958 26772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:18.317006 26772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:18.318436 26772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:32785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=45501
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:18.318682 26772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:18.318897 26772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:18.324637 26797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.324666 26798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.324636 26800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.325140 26772 server_base.cc:1034] running on GCE node
I20260929 22:48:18.325372 26772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:18.325618 26772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:18.326834 26772 hybrid_clock.cc:648] HybridClock initialized: now 1790722098326820 us; error 31 us; skew 500 ppm
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:18.329507 26772 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:18.329990 26772 webserver.cc:460] Webserver started at http://127.12.27.129:45501/ using document root <none> and password file <none>
I20260929 22:48:18.330216 26772 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:18.330298 26772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:18.331743 26772 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:48:18.332499 26807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.332679 26772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:18.332773 26772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "9d47c39957214c08827484c6820071fd"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "43aec8ec4e637a9f4ae86682821663f8"
server_key_iv: "a4f45957ac2f487a383c16c84b5f76e4"
server_key_version: "encryptionkey@0"
I20260929 22:48:18.333123 26772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:18.343930 26772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:18.346014 26772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:18.346179 26772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:18.346437 26772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:18.346881 26814 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:48:18.348891 26772 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:48:18.348975 26772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:48:18.349031 26772 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:48:18.349774 26772 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:48:18.349830 26772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:18.349911 26814 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Bootstrap starting.
I20260929 22:48:18.357144 26772 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:32785
I20260929 22:48:18.357506 26772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:18.360435 26921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:32785 every 8 connection(s)
I20260929 22:48:18.360800 26814 log.cc:824] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:18.363441 26814 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:18.363787 26814 tablet_bootstrap.cc:492] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Bootstrap complete.
I20260929 22:48:18.364436 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26772
I20260929 22:48:18.364733 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:38245
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:41203
--webserver_port=36975
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:18.365069 26814 ts_tablet_manager.cc:1397] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260929 22:48:18.366415 26814 raft_consensus.cc:348] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.366736 26814 raft_consensus.cc:729] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d47c39957214c08827484c6820071fd, State: Initialized, Role: FOLLOWER
I20260929 22:48:18.366887 26814 consensus_queue.cc:260] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.367154 26814 ts_tablet_manager.cc:1428] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:18.375290 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.358262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:59983)
0929 22:48:18.359796 (+ 1534us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.359834 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.360265 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.364164 (+ 3899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.364168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.364655 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:18.365234 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.365243 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.366738 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.366739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.368062 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.368066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.368885 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.368886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.368986 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.369570 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:18.369578 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:18.371155 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:18.373460 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:18.373467 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:18.373469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:18.373752 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:18.374080 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:18.374080 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:18.374081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:18.374204 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:18.374680 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:18.374685 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:18.374829 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.374936 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.375092 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1493,"thread_start_us":92,"threads_started":1}
I20260929 22:48:18.375473 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.358343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:59983 (local address 127.12.27.190:41203)
0929 22:48:18.363754 (+ 5411us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.363762 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.363790 (+ 28us) server_negotiation.cc:407] Connection header received
0929 22:48:18.363943 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.363949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.363991 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.364136 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:18.365374 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.366633 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.368171 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.368773 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.368909 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.371276 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:18.371280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:18.371280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:18.371292 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:18.373353 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.373856 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.373860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.373861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.374001 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.374280 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.374281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.374282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.374601 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:18.374698 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.375022 (+ 324us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.375226 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5364,"thread_start_us":91,"threads_started":1}
I20260929 22:48:18.376087 26922 heartbeater.cc:347] Connected to a master server at 127.12.27.190:41203
I20260929 22:48:18.376197 26922 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:18.376420 26922 heartbeater.cc:511] Master 127.12.27.190:41203 requested a full tablet report, sending...
I20260929 22:48:18.377261 26734 ts_manager.cc:194] Registered new tserver with Master: 9d47c39957214c08827484c6820071fd (127.12.27.129:32785)
I20260929 22:48:18.378610 26734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:59983
I20260929 22:48:18.380075 26922 heartbeater.cc:503] Master 127.12.27.190:41203 was elected leader, sending a full tablet report...
I20260929 22:48:18.384166 26929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.379071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:32785 (local address 127.0.0.1:49092)
0929 22:48:18.379807 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.379843 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.379935 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.380363 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.380367 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.380370 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.380492 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.380498 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.381667 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.381667 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.382950 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.382953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.383856 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.383857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.383949 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.383963 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.384041 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.384089 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":87,"threads_started":1}
I20260929 22:48:18.384167 26930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.379122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49092 (local address 127.12.27.129:32785)
0929 22:48:18.379740 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.379745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.379901 (+ 156us) server_negotiation.cc:407] Connection header received
0929 22:48:18.380066 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.380068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.380083 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.380231 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.380587 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.381568 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.383047 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.383770 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.383854 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.383904 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.384063 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.384100 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":84,"threads_started":1}
I20260929 22:48:18.384876 26840 tablet_service.cc:1514] Processing DeleteTablet for tablet 3420aed867a443c99590bedf6939373f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49092
I20260929 22:48:18.385432 26931 tablet_replica.cc:330] stopping tablet replica
I20260929 22:48:18.385528 26931 raft_consensus.cc:2229] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:18.385593 26931 raft_consensus.cc:2258] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:18.385895 26931 ts_tablet_manager.cc:1905] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:18.388482 26931 ts_tablet_manager.cc:1918] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:18.388556 26931 log.cc:1196] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/3420aed867a443c99590bedf6939373f
I20260929 22:48:18.388779 26931 ts_tablet_manager.cc:1939] T 3420aed867a443c99590bedf6939373f P 9d47c39957214c08827484c6820071fd: Deleting consensus metadata
I20260929 22:48:18.389284 26718 catalog_manager.cc:4841] TS 9d47c39957214c08827484c6820071fd (127.12.27.129:32785): tablet 3420aed867a443c99590bedf6939373f (table test-table [id=d5bddcc809104a5b8c0c2c541eff2537]) successfully deleted
W20260929 22:48:18.456395 26927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:18.456588 26927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:18.456610 26927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:18.457674 26927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:18.457705 26927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:18.457731 26927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:18.459080 26927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:38245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=36975
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:18.459261 26927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:18.459458 26927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:18.464380 26937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.464392 26939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.464512 26927 server_base.cc:1034] running on GCE node
W20260929 22:48:18.464394 26936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.464812 26927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:18.465055 26927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:18.466223 26927 hybrid_clock.cc:648] HybridClock initialized: now 1790722098466203 us; error 36 us; skew 500 ppm
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:18.468788 26927 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:18.469220 26927 webserver.cc:460] Webserver started at http://127.12.27.130:36975/ using document root <none> and password file <none>
I20260929 22:48:18.469489 26927 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:18.469588 26927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:18.470893 26927 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:18.471691 26946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.471897 26927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:18.472010 26927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "b3cbcb809a0d49d082d49869383a589a"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "fd4191eda44dcfcbed22fe5700a27daa"
server_key_iv: "3fbf21504b52997963ef5fee9a1d5939"
server_key_version: "encryptionkey@0"
I20260929 22:48:18.472369 26927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:18.493363 26927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:18.495332 26927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:18.495500 26927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:18.495774 26927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:18.496076 26927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:18.496130 26927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.496171 26927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:18.496197 26927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.501951 26927 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:38245
I20260929 22:48:18.501997 27059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:38245 every 8 connection(s)
I20260929 22:48:18.502365 26927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:48:18.504993 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 26927
I20260929 22:48:18.505290 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:38977
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:41203
--webserver_port=38465
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:18.512575 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.503078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:52725 (local address 127.12.27.190:41203)
0929 22:48:18.503164 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.503167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.503420 (+ 253us) server_negotiation.cc:407] Connection header received
0929 22:48:18.503972 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.503973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.503987 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.504041 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:18.504970 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.505780 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.506831 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.507048 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.507140 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.509574 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:18.509576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:18.509576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:18.509584 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:18.511015 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.511483 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.511484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.511484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.511533 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.511805 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.511806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.511806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.511948 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:18.512027 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.512362 (+ 335us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.512482 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 22:48:18.512710 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.503068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:52725)
0929 22:48:18.503259 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.503293 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.503842 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.504105 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.504109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.504667 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:18.504850 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.504855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.505899 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.505900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.506698 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.506700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.507153 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.507154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.507291 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.507870 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:18.507878 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:18.509471 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:18.511115 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:18.511121 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:18.511123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:18.511367 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:18.511604 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:18.511605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:18.511605 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:18.511735 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:18.512018 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:18.512025 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:18.512204 (+ 179us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.512319 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.512485 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
I20260929 22:48:18.513135 27060 heartbeater.cc:347] Connected to a master server at 127.12.27.190:41203
I20260929 22:48:18.513237 27060 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:18.513448 27060 heartbeater.cc:511] Master 127.12.27.190:41203 requested a full tablet report, sending...
I20260929 22:48:18.513857 26734 ts_manager.cc:194] Registered new tserver with Master: b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
I20260929 22:48:18.514232 26734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:52725
W20260929 22:48:18.588663 27063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:18.588865 27063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:18.588889 27063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:18.590113 27063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:18.590154 27063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:18.590181 27063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:18.591675 27063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:38977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=38465
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:18.591929 27063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:18.592162 27063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:18.597255 27068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.597265 27069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.597496 27063 server_base.cc:1034] running on GCE node
W20260929 22:48:18.597255 27071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.597796 27063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:18.597998 27063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:18.599169 27063 hybrid_clock.cc:648] HybridClock initialized: now 1790722098599151 us; error 30 us; skew 500 ppm
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:18.601917 27063 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:18.602348 27063 webserver.cc:460] Webserver started at http://127.12.27.131:38465/ using document root <none> and password file <none>
I20260929 22:48:18.602612 27063 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:18.602695 27063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:18.604293 27063 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:48:18.604993 27078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.605209 27063 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:48:18.605319 27063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "d229de32c5ff473f983900f9945db570"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "074434b8d804d4599dc4a18860c29709"
server_key_iv: "52d9f1962bd2501bf471a97195350347"
server_key_version: "encryptionkey@0"
I20260929 22:48:18.605711 27063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:18.626118 27063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:18.628247 27063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:18.628412 27063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:18.628691 27063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:18.629005 27063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:18.629062 27063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.629107 27063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:18.629153 27063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.635203 27063 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38977
I20260929 22:48:18.635244 27191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38977 every 8 connection(s)
I20260929 22:48:18.635608 27063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:48:18.640611 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27063
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:18.645476 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.636356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:60885 (local address 127.12.27.190:41203)
0929 22:48:18.636406 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.636408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.636649 (+ 241us) server_negotiation.cc:407] Connection header received
0929 22:48:18.637112 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.637113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.637124 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.637177 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:18.638061 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.638544 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.639509 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.639769 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.639831 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.642224 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:18.642225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:18.642226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:18.642232 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:18.643945 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.644429 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.644431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.644431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.644493 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.644799 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.644800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.644800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.644960 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:18.645035 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.645289 (+ 254us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.645372 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:48:18.645510 27194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.636364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:60885)
0929 22:48:18.636528 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.636563 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.637027 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.637229 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.637232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.637785 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:18.637977 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.637982 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.638630 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.638631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.639423 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.639425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.639839 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.639840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.639935 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.640351 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:18.640358 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:18.642132 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:18.644022 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:18.644029 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:18.644031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:18.644355 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:18.644573 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:18.644574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:18.644574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:18.644717 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:18.645033 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:18.645038 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:18.645151 (+ 113us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.645238 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.645353 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":102,"threads_started":1}
I20260929 22:48:18.645990 27192 heartbeater.cc:347] Connected to a master server at 127.12.27.190:41203
I20260929 22:48:18.646104 27192 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:18.646307 27192 heartbeater.cc:511] Master 127.12.27.190:41203 requested a full tablet report, sending...
I20260929 22:48:18.646703 26734 ts_manager.cc:194] Registered new tserver with Master: d229de32c5ff473f983900f9945db570 (127.12.27.131:38977)
I20260929 22:48:18.647063 26734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:60885
I20260929 22:48:18.648710 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.641035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35376 (local address 127.12.27.190:41203)
0929 22:48:18.641152 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.641154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.641162 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:48:18.641235 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.641236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.641244 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.641290 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:18.641979 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.642722 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.643893 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.644179 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.644255 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.645928 (+ 1673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:18.645929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:18.645929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:18.645934 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:18.647614 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.648018 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.648018 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.648019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.648093 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:18.648239 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:18.648239 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:18.648240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:18.648331 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:18.648497 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.648525 (+ 28us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.648583 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260929 22:48:18.649613 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:48:18.652210 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.649975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35380 (local address 127.12.27.190:41203)
0929 22:48:18.650015 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.650017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.650134 (+ 117us) server_negotiation.cc:407] Connection header received
0929 22:48:18.650188 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.650188 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.650215 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.650269 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:18.650366 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.650802 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.651494 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.651751 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.651805 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.651937 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:18.652019 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:18.652081 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.652097 (+ 16us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.652115 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:48:18.652496 26734 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35380:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:48:18.654042 26734 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:48:18.656335 26840 tablet_service.cc:1467] Processing CreateTablet for tablet 2f85704e03ee4d15877faa54a4edfe8a (DEFAULT_TABLE table=test-table [id=06c18f124e8f40ad81cd8579a351b4c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:18.656574 26840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f85704e03ee4d15877faa54a4edfe8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:18.657994 26814 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Bootstrap starting.
I20260929 22:48:18.658327 26814 tablet_bootstrap.cc:654] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:18.659432 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.656019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52702 (local address 127.12.27.131:38977)
0929 22:48:18.656191 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.656196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.656205 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:18.656241 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.656243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.656258 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.656373 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.656492 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.657474 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.658512 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.659135 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.659190 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.659225 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.659349 (+ 124us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.659372 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260929 22:48:18.659454 26929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.655891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38977 (local address 127.0.0.1:52702)
0929 22:48:18.655933 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.655945 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.655983 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.656375 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.656376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.656377 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.656411 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.656415 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.657570 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.657571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.658419 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.658421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.659210 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.659211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.659274 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.659278 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.659340 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.659379 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260929 22:48:18.659906 26814 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: No bootstrap required, opened a new log
I20260929 22:48:18.659964 26814 ts_tablet_manager.cc:1397] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260929 22:48:18.660079 26814 raft_consensus.cc:348] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.660152 26814 raft_consensus.cc:374] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:18.660203 26814 raft_consensus.cc:729] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d47c39957214c08827484c6820071fd, State: Initialized, Role: FOLLOWER
I20260929 22:48:18.660257 26814 consensus_queue.cc:260] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.660229 27126 tablet_service.cc:1467] Processing CreateTablet for tablet 2f85704e03ee4d15877faa54a4edfe8a (DEFAULT_TABLE table=test-table [id=06c18f124e8f40ad81cd8579a351b4c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:18.660359 26814 ts_tablet_manager.cc:1428] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.660562 27126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f85704e03ee4d15877faa54a4edfe8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:18.661895 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.655950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38245 (local address 127.0.0.1:54250)
0929 22:48:18.658055 (+ 2105us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.658066 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.658124 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.658345 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.658346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.658348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.658451 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.658453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.659780 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.659781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.660966 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.660969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.661678 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.661679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.661719 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.661722 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.661791 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.661829 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2085,"thread_start_us":100,"threads_started":1}
I20260929 22:48:18.661927 27200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.656189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54250 (local address 127.12.27.130:38245)
0929 22:48:18.656337 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.656341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.658187 (+ 1846us) server_negotiation.cc:407] Connection header received
0929 22:48:18.658236 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.658239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.658255 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.658338 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.658534 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.659402 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.661061 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.661562 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.661599 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.661629 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.661804 (+ 175us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.661839 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260929 22:48:18.663255 27202 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Bootstrap starting.
I20260929 22:48:18.663972 27202 tablet_bootstrap.cc:654] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:18.663976 26994 tablet_service.cc:1467] Processing CreateTablet for tablet 2f85704e03ee4d15877faa54a4edfe8a (DEFAULT_TABLE table=test-table [id=06c18f124e8f40ad81cd8579a351b4c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:18.664321 26994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f85704e03ee4d15877faa54a4edfe8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:18.664510 27202 log.cc:824] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:18.665184 27202 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: No bootstrap required, opened a new log
I20260929 22:48:18.665236 27202 ts_tablet_manager.cc:1397] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:48:18.666551 27202 raft_consensus.cc:348] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.666674 27202 raft_consensus.cc:374] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:18.666695 27202 raft_consensus.cc:729] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d229de32c5ff473f983900f9945db570, State: Initialized, Role: FOLLOWER
I20260929 22:48:18.666815 27202 consensus_queue.cc:260] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.667119 27202 ts_tablet_manager.cc:1428] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:48:18.667213 27192 heartbeater.cc:503] Master 127.12.27.190:41203 was elected leader, sending a full tablet report...
I20260929 22:48:18.667323 27204 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Bootstrap starting.
I20260929 22:48:18.667991 27204 tablet_bootstrap.cc:654] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:18.668465 27204 log.cc:824] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:18.669142 27204 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: No bootstrap required, opened a new log
I20260929 22:48:18.669222 27204 ts_tablet_manager.cc:1397] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:48:18.670819 27204 raft_consensus.cc:348] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.670960 27204 raft_consensus.cc:374] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:18.671005 27204 raft_consensus.cc:729] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbcb809a0d49d082d49869383a589a, State: Initialized, Role: FOLLOWER
I20260929 22:48:18.671119 27204 consensus_queue.cc:260] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.671375 27204 ts_tablet_manager.cc:1428] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:48:18.671465 27060 heartbeater.cc:503] Master 127.12.27.190:41203 was elected leader, sending a full tablet report...
W20260929 22:48:18.752931 27061 tablet.cc:2369] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:48:18.788213 26928 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:18.788348 26928 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.788661 26928 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
I20260929 22:48:18.791930 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.788866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38245 (local address 127.12.27.129:58101)
0929 22:48:18.788928 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.788941 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.789013 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.789218 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.789220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.789222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.789295 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.789297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.790181 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.790182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.790961 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.790964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.791670 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.791671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.791766 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.791771 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.791825 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.791870 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260929 22:48:18.791981 27200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.788984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:58101 (local address 127.12.27.130:38245)
0929 22:48:18.789036 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.789039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.789084 (+ 45us) server_negotiation.cc:407] Connection header received
0929 22:48:18.789118 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.789121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.789136 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.789188 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.789435 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.790086 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.791062 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.791560 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.791621 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.791678 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.791848 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.791888 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 22:48:18.792135 27208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.788867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38977 (local address 127.12.27.129:44791)
0929 22:48:18.789277 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.789295 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:18.789379 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:18.789524 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:18.789524 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:18.789526 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:18.789603 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.789605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.790278 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.790278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.791174 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:18.791177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.791832 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.791833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:18.791914 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.791919 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:48:18.791984 (+ 65us) client_negotiation.cc:240] Negotiation successful
0929 22:48:18.792030 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":193,"thread_start_us":131,"threads_started":1}
I20260929 22:48:18.792130 27199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.789022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:44791 (local address 127.12.27.131:38977)
0929 22:48:18.789075 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.789077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.789388 (+ 311us) server_negotiation.cc:407] Connection header received
0929 22:48:18.789441 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.789442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.789458 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.789501 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:18.789694 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.790191 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.791264 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.791712 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.791783 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.791791 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.792003 (+ 212us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.792049 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:48:18.792297 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f85704e03ee4d15877faa54a4edfe8a" candidate_uuid: "9d47c39957214c08827484c6820071fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbcb809a0d49d082d49869383a589a" is_pre_election: true
I20260929 22:48:18.792541 27014 raft_consensus.cc:2454] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d47c39957214c08827484c6820071fd in term 0.
I20260929 22:48:18.792495 27146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f85704e03ee4d15877faa54a4edfe8a" candidate_uuid: "9d47c39957214c08827484c6820071fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d229de32c5ff473f983900f9945db570" is_pre_election: true
I20260929 22:48:18.792665 27146 raft_consensus.cc:2454] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d47c39957214c08827484c6820071fd in term 0.
I20260929 22:48:18.792824 26811 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d47c39957214c08827484c6820071fd, b3cbcb809a0d49d082d49869383a589a; no voters:
I20260929 22:48:18.792963 26928 raft_consensus.cc:2781] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:48:18.793022 26928 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:48:18.793044 26928 raft_consensus.cc:3037] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:18.793780 26928 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.793920 26928 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 1 election: Requested vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
I20260929 22:48:18.794094 27146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f85704e03ee4d15877faa54a4edfe8a" candidate_uuid: "9d47c39957214c08827484c6820071fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d229de32c5ff473f983900f9945db570"
I20260929 22:48:18.794072 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f85704e03ee4d15877faa54a4edfe8a" candidate_uuid: "9d47c39957214c08827484c6820071fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbcb809a0d49d082d49869383a589a"
I20260929 22:48:18.794155 27146 raft_consensus.cc:3037] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:18.794181 27014 raft_consensus.cc:3037] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:18.794821 27146 raft_consensus.cc:2454] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d47c39957214c08827484c6820071fd in term 1.
I20260929 22:48:18.795004 26810 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d47c39957214c08827484c6820071fd, d229de32c5ff473f983900f9945db570; no voters:
I20260929 22:48:18.795073 27014 raft_consensus.cc:2454] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d47c39957214c08827484c6820071fd in term 1.
I20260929 22:48:18.795128 26928 raft_consensus.cc:2781] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:18.795301 26928 raft_consensus.cc:686] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 LEADER]: Becoming Leader. State: Replica: 9d47c39957214c08827484c6820071fd, State: Running, Role: LEADER
I20260929 22:48:18.795389 26928 consensus_queue.cc:237] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:18.796260 26734 catalog_manager.cc:5495] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d47c39957214c08827484c6820071fd (127.12.27.129). New cstate: current_term: 1 leader_uuid: "9d47c39957214c08827484c6820071fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } health_report { overall_health: HEALTHY } } }
I20260929 22:48:18.807467 26930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.805123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49100 (local address 127.12.27.129:32785)
0929 22:48:18.805186 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:18.805188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:18.805196 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:48:18.805233 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:18.805234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:18.805259 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:18.805338 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:18.805469 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.805927 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.806655 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:18.806838 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:18.806911 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:18.807083 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:18.807175 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:18.807249 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:18.807304 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 22:48:18.807325 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:48:18.808920 27014 raft_consensus.cc:1261] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Refusing update from remote peer 9d47c39957214c08827484c6820071fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:18.808923 27146 raft_consensus.cc:1261] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Refusing update from remote peer 9d47c39957214c08827484c6820071fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:18.809288 26928 consensus_queue.cc:1035] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:18.809448 27209 consensus_queue.cc:1035] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:18.811918 27214 mvcc.cc:205] Tried to move back new op lower bound from 7334797716718886912 to 7334797716666531840. Current Snapshot: MvccSnapshot[applied={T|T < 7334797716718886912}]
I20260929 22:48:18.814289 26734 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:18.814375 26734 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:18.815075 26734 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Sending DeleteTablet for 3 replicas of tablet 2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:18.815394 26840 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f85704e03ee4d15877faa54a4edfe8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:49092
I20260929 22:48:18.815413 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26772
I20260929 22:48:18.815444 26994 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f85704e03ee4d15877faa54a4edfe8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:54250
I20260929 22:48:18.816149 27126 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f85704e03ee4d15877faa54a4edfe8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:18 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:52702
I20260929 22:48:18.816174 27222 tablet_replica.cc:330] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: stopping tablet replica
I20260929 22:48:18.816272 27222 raft_consensus.cc:2229] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:18.816366 27222 raft_consensus.cc:2258] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:18.816875 27222 ts_tablet_manager.cc:1905] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:18.817342 27223 tablet_replica.cc:330] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: stopping tablet replica
I20260929 22:48:18.817461 27223 raft_consensus.cc:2229] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:18.817571 27223 raft_consensus.cc:2258] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:18.818898 27222 ts_tablet_manager.cc:1918] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:18.818975 27222 log.cc:1196] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:18.819262 27222 ts_tablet_manager.cc:1939] T 2f85704e03ee4d15877faa54a4edfe8a P b3cbcb809a0d49d082d49869383a589a: Deleting consensus metadata
I20260929 22:48:18.819657 26721 catalog_manager.cc:4841] TS b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): tablet 2f85704e03ee4d15877faa54a4edfe8a (table test-table [id=06c18f124e8f40ad81cd8579a351b4c4]) successfully deleted
I20260929 22:48:18.819971 27223 ts_tablet_manager.cc:1905] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:18.821236 27223 ts_tablet_manager.cc:1918] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260929 22:48:18.821230 26718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:32785 (error 108)
I20260929 22:48:18.821332 27223 log.cc:1196] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:18.821722 27223 ts_tablet_manager.cc:1939] T 2f85704e03ee4d15877faa54a4edfe8a P d229de32c5ff473f983900f9945db570: Deleting consensus metadata
I20260929 22:48:18.821734 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:18.821600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:32785 (local address 127.0.0.1:49116)
0929 22:48:18.821657 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:18.821695 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:32785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 22:48:18.821851 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26927
W20260929 22:48:18.821841 26718 catalog_manager.cc:4584] TS 9d47c39957214c08827484c6820071fd (127.12.27.129:32785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2f85704e03ee4d15877faa54a4edfe8a: Network error: Client connection negotiation failed: client connection to 127.12.27.129:32785: connect: Connection refused (error 111)
I20260929 22:48:18.822429 26720 catalog_manager.cc:4841] TS d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): tablet 2f85704e03ee4d15877faa54a4edfe8a (table test-table [id=06c18f124e8f40ad81cd8579a351b4c4]) successfully deleted
I20260929 22:48:18.827188 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 27063
I20260929 22:48:18.832516 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 26701
I20260929 22:48:18.837809 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41203
--webserver_interface=127.12.27.190
--webserver_port=35789
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:41203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:18.917569 27225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:18.917781 27225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:18.917817 27225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:18.918995 27225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:18.919059 27225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:18.919085 27225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:18.919113 27225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:18.919142 27225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:18.920675 27225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:41203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:41203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=35789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:18.920938 27225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:18.921149 27225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:18.925971 27233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.925983 27231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:18.925969 27230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:18.926280 27225 server_base.cc:1034] running on GCE node
I20260929 22:48:18.926508 27225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:18.926779 27225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:18.927937 27225 hybrid_clock.cc:648] HybridClock initialized: now 1790722098927944 us; error 47 us; skew 500 ppm
Sep 29 22:48:18 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722098, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:18.930523 27225 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:18.931010 27225 webserver.cc:460] Webserver started at http://127.12.27.190:35789/ using document root <none> and password file <none>
I20260929 22:48:18.931248 27225 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:18.931316 27225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:18.932818 27225 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:18.933581 27240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:18.933774 27225 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:18.933903 27225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1e720ca479ae43e98e50ee735ee4199b"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "e81fdcce8ed404e57d84ff622cc8ccf9"
server_key_iv: "5ff1416c056152a3d3465c450a54e6f9"
server_key_version: "encryptionkey@0"
I20260929 22:48:18.934239 27225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:18.946209 27225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:18.948415 27225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:18.948586 27225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:18.952664 27225 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:41203
I20260929 22:48:18.952697 27292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:41203 every 8 connection(s)
I20260929 22:48:18.953063 27225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:18.954583 27293 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:48:18.955368 27293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap starting.
I20260929 22:48:18.962548 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27225
I20260929 22:48:18.962849 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:32785
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:41203
--webserver_port=45501
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:18.964051 27293 log.cc:824] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:18.966418 27293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:18.966720 27293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b: Bootstrap complete.
I20260929 22:48:18.969015 27293 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.969269 27293 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e720ca479ae43e98e50ee735ee4199b, State: Initialized, Role: FOLLOWER
I20260929 22:48:18.969448 27293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.969532 27293 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:18.969599 27293 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:18.969648 27293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 2 FOLLOWER]: Advancing to term 3
I20260929 22:48:18.970620 27293 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.970736 27293 leader_election.cc:302] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e720ca479ae43e98e50ee735ee4199b; no voters:
I20260929 22:48:18.970927 27293 leader_election.cc:288] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 22:48:18.970968 27297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 3 FOLLOWER]: Leader election won for term 3
I20260929 22:48:18.971074 27297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [term 3 LEADER]: Becoming Leader. State: Replica: 1e720ca479ae43e98e50ee735ee4199b, State: Running, Role: LEADER
I20260929 22:48:18.971208 27293 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:18.971217 27297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } }
I20260929 22:48:18.971565 27298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1e720ca479ae43e98e50ee735ee4199b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } } }
I20260929 22:48:18.971679 27298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:18.971954 27299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e720ca479ae43e98e50ee735ee4199b. Latest consensus state: current_term: 3 leader_uuid: "1e720ca479ae43e98e50ee735ee4199b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e720ca479ae43e98e50ee735ee4199b" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 41203 } } }
I20260929 22:48:18.972038 27299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e720ca479ae43e98e50ee735ee4199b [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:18.972152 27303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:18.973038 27303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:18.973137 27303 catalog_manager.cc:1259] Loaded cluster ID: 7f188fbcf7e547cca705f46112f19230
I20260929 22:48:18.973169 27303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260929 22:48:18.973459 27303 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0e682469ad google::LogMessage::Fail() at ??:0
@ 0x7f0e6824988a google::LogMessage::SendToLog() at ??:0
@ 0x7f0e682464de google::LogMessage::Flush() at ??:0
@ 0x7f0e68247a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0e701670f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f0e701708b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0e6a1140d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0e6a109954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0e6af6d6db start_thread at ??:0
@ 0x7f0e66d4461f clone at ??:0
W20260929 22:48:19.088615 27295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:19.088883 27295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:19.088919 27295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:19.090595 27295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:19.090652 27295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:19.090692 27295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:19.092609 27295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:32785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=45501
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:19.092792 27295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:19.092962 27295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:19.098871 27332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:19.099040 27329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:19.099341 27330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:19.099714 27295 server_base.cc:1034] running on GCE node
I20260929 22:48:19.099932 27295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:19.100201 27295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:19.101402 27295 hybrid_clock.cc:648] HybridClock initialized: now 1790722099101387 us; error 41 us; skew 500 ppm
Sep 29 22:48:19 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722099, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:19.104384 27295 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:19.104839 27295 webserver.cc:460] Webserver started at http://127.12.27.129:45501/ using document root <none> and password file <none>
I20260929 22:48:19.105077 27295 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:19.105145 27295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:19.106630 27295 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:19.107399 27339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.107591 27295 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:19.107704 27295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "9d47c39957214c08827484c6820071fd"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "43aec8ec4e637a9f4ae86682821663f8"
server_key_iv: "a4f45957ac2f487a383c16c84b5f76e4"
server_key_version: "encryptionkey@0"
I20260929 22:48:19.108129 27295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:19.122483 27295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:19.124888 27295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:19.125066 27295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:19.125310 27295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:19.125747 27346 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:48:19.127696 27295 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:48:19.127755 27295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:48:19.127801 27295 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:48:19.128504 27295 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:48:19.128557 27295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:19.128630 27346 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Bootstrap starting.
I20260929 22:48:19.135973 27295 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:32785
I20260929 22:48:19.136111 27453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:32785 every 8 connection(s)
I20260929 22:48:19.136397 27295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:19.138486 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27295
I20260929 22:48:19.138792 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:38245
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:41203
--webserver_port=36975
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:19.140626 27346 log.cc:824] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:19.142825 27346 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:19.143105 27346 tablet_bootstrap.cc:492] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Bootstrap complete.
I20260929 22:48:19.144090 27346 ts_tablet_manager.cc:1397] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260929 22:48:19.145109 27346 raft_consensus.cc:348] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:19.145383 27346 raft_consensus.cc:729] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d47c39957214c08827484c6820071fd, State: Initialized, Role: FOLLOWER
I20260929 22:48:19.145539 27346 consensus_queue.cc:260] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:19.145823 27346 ts_tablet_manager.cc:1428] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260929 22:48:19.232609 27456 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:48:19.137115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:35763)
0929 22:48:19.137301 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.137340 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:19.137788 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:19.232388 (+ 94600us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":95,"threads_started":1}
W20260929 22:48:19.232883 27454 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:41203 (0 consecutive failures): Network error: Failed to ping master at 127.12.27.190:41203: Client connection negotiation failed: client connection to 127.12.27.190:41203: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:48:19.233218 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.233100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:49611)
0929 22:48:19.233156 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.233199 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 22:48:19.233583 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.233499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:45971)
0929 22:48:19.233546 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.233569 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:48:19.233726 27454 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:48:19.237088 27457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:19.237301 27457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:19.237349 27457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:19.238488 27457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:19.238554 27457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:19.238601 27457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:19.240125 27457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:38245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=36975
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:19.240381 27457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:19.240609 27457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:19.245729 27464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:19.245733 27465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:19.245991 27457 server_base.cc:1034] running on GCE node
W20260929 22:48:19.245770 27467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:19.246250 27457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:19.246503 27457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:19.247690 27457 hybrid_clock.cc:648] HybridClock initialized: now 1790722099247661 us; error 38 us; skew 500 ppm
Sep 29 22:48:19 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722099, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:19.250437 27457 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:19.250877 27457 webserver.cc:460] Webserver started at http://127.12.27.130:36975/ using document root <none> and password file <none>
I20260929 22:48:19.251106 27457 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:19.251176 27457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:19.252641 27457 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:19.253192 27474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.253409 27457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:19.253517 27457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "b3cbcb809a0d49d082d49869383a589a"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "fd4191eda44dcfcbed22fe5700a27daa"
server_key_iv: "3fbf21504b52997963ef5fee9a1d5939"
server_key_version: "encryptionkey@0"
I20260929 22:48:19.253871 27457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:19.264557 27457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:19.266845 27457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:19.267004 27457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:19.267231 27457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:19.267535 27457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:19.267588 27457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.267647 27457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:19.267678 27457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.273869 27457 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:38245
I20260929 22:48:19.273958 27587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:38245 every 8 connection(s)
I20260929 22:48:19.274288 27457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:48:19.274643 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27457
I20260929 22:48:19.274962 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:38977
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:41203
--webserver_port=38465
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:19.275655 27590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.275040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:46201)
0929 22:48:19.275232 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.275404 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
W20260929 22:48:19.276149 27588 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:41203 (0 consecutive failures): Network error: Failed to ping master at 127.12.27.190:41203: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
I20260929 22:48:19.276448 27590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.276348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:50529)
0929 22:48:19.276399 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.276425 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:48:19.276834 27592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.276625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:46789)
0929 22:48:19.276765 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.276800 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
W20260929 22:48:19.276973 27588 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:48:19.360004 27591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:19.360199 27591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:19.360222 27591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:19.361280 27591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:19.361315 27591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:19.361356 27591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:19.362697 27591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:38977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=38465
--tserver_master_addrs=127.12.27.190:41203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:19.362867 27591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:19.363029 27591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:19.367949 27598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:19.367978 27597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:19.367955 27600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:19.368228 27591 server_base.cc:1034] running on GCE node
I20260929 22:48:19.368510 27591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:19.368702 27591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:19.369839 27591 hybrid_clock.cc:648] HybridClock initialized: now 1790722099369828 us; error 28 us; skew 500 ppm
Sep 29 22:48:19 dist-test-slave-00d6 krb5kdc[26157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722099, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:19.372303 27591 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:19.372752 27591 webserver.cc:460] Webserver started at http://127.12.27.131:38465/ using document root <none> and password file <none>
I20260929 22:48:19.372987 27591 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:19.373055 27591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:19.374331 27591 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:19.374897 27607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.375066 27591 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.375160 27591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "d229de32c5ff473f983900f9945db570"
format_stamp: "Formatted at 2026-09-29 22:48:17 on dist-test-slave-00d6"
server_key: "074434b8d804d4599dc4a18860c29709"
server_key_iv: "52d9f1962bd2501bf471a97195350347"
server_key_version: "encryptionkey@0"
I20260929 22:48:19.375507 27591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:19.385082 27591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:19.386961 27591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:19.387120 27591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:19.387332 27591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:19.387686 27591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:19.387748 27591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.387786 27591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:19.387814 27591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:19.393602 27591 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38977
I20260929 22:48:19.393640 27720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38977 every 8 connection(s)
I20260929 22:48:19.394006 27591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:48:19.395076 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.394672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:44235)
0929 22:48:19.394810 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.394906 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
W20260929 22:48:19.395577 27721 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:41203 (0 consecutive failures): Network error: Failed to ping master at 127.12.27.190:41203: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
I20260929 22:48:19.396062 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.395952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:49535)
0929 22:48:19.396004 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.396038 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 22:48:19.396430 27723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:19.396291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:46343)
0929 22:48:19.396377 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:19.396409 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260929 22:48:19.396543 27721 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:48:19.400543 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27591
I20260929 22:48:20.234340 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.234074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:47949)
0929 22:48:20.234224 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:20.234268 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":60,"threads_started":1}
I20260929 22:48:20.277514 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.277301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:50417)
0929 22:48:20.277422 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:20.277460 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260929 22:48:20.297986 27727 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:20.298110 27727 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:20.298452 27727 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
Sep 29 22:48:20 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722099, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.130@KRBTEST.COM
Sep 29 22:48:20 dist-test-slave-00d6 krb5kdc[26157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722099, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.131@KRBTEST.COM
I20260929 22:48:20.311743 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.298785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:35037 (local address 127.12.27.131:38977)
0929 22:48:20.298930 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:20.298949 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:20.298970 (+ 21us) server_negotiation.cc:407] Connection header received
0929 22:48:20.299574 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:20.299577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:20.299686 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:20.299866 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:20.300889 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.302332 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.304100 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.304735 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.304857 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:20.308249 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:20.308252 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:20.308253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:20.308265 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:20.310196 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310568 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:20.310571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:20.310571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:20.310683 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310943 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:20.310943 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:20.310944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:20.311167 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:20.311264 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:20.311456 (+ 192us) server_negotiation.cc:299] Negotiation successful
0929 22:48:20.311594 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260929 22:48:20.311743 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.298714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:38245 (local address 127.12.27.129:47617)
0929 22:48:20.298838 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:20.298848 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:20.298924 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:20.299928 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:20.299931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:20.300431 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:20.300727 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:20.300735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.302458 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.302459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:20.303976 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:20.303979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.304848 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.304849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:20.305017 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:20.305760 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:20.305771 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:20.307609 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:20.309836 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:20.309843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:20.309845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:20.310074 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:20.310437 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:20.310439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:20.310597 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:20.311141 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:20.311148 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:20.311276 (+ 128us) client_negotiation.cc:769] Sending connection context
0929 22:48:20.311451 (+ 175us) client_negotiation.cc:240] Negotiation successful
0929 22:48:20.311616 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":80,"thread_start_us":70,"threads_started":1}
I20260929 22:48:20.311784 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.298907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:47617 (local address 127.12.27.130:38245)
0929 22:48:20.299054 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:20.299062 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:20.299079 (+ 17us) server_negotiation.cc:407] Connection header received
0929 22:48:20.299732 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:20.299735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:20.299783 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:20.299893 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:20.300885 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.302335 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.304099 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.304735 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.304857 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:20.307767 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:20.307772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:20.307772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:20.307784 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:20.309612 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310168 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:20.310171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:20.310171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:20.310298 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310696 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:20.310697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:20.310697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:20.311063 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:20.311162 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:20.311519 (+ 357us) server_negotiation.cc:299] Negotiation successful
0929 22:48:20.311682 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260929 22:48:20.311882 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.298621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38977 (local address 127.12.27.129:35037)
0929 22:48:20.298687 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:20.298701 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:20.298767 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:20.299928 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:20.299931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:20.300479 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:20.300726 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:20.300735 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.302465 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.302466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:20.303976 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:20.303979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:20.304847 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:20.304848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:20.305017 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:20.305819 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:20.305824 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:20.308159 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:20.310270 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:20.310271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:20.310497 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:20.310766 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:20.310766 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:20.310767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:20.310833 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:20.311249 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:20.311250 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:20.311297 (+ 47us) client_negotiation.cc:769] Sending connection context
0929 22:48:20.311405 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 22:48:20.311725 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":258}
W20260929 22:48:20.312546 27343 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
W20260929 22:48:20.313062 27342 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:20.313110 27342 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d47c39957214c08827484c6820071fd; no voters: b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570
I20260929 22:48:20.313223 27727 raft_consensus.cc:2726] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:48:20.397080 27731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:20.396870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:51351)
0929 22:48:20.396996 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:20.397042 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260929 22:48:21.235222 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:21.235005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:59371)
0929 22:48:21.235137 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:21.235176 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260929 22:48:21.278442 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:21.277999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:46277)
0929 22:48:21.278140 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:21.278181 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
I20260929 22:48:21.397841 27734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:21.397607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:51753)
0929 22:48:21.397765 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:21.397804 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260929 22:48:22.236066 27735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:22.235806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:53065)
0929 22:48:22.235977 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:22.236019 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260929 22:48:22.279220 27736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:22.278992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:42247)
0929 22:48:22.279127 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:22.279171 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260929 22:48:22.398597 27737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:22.398322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:47911)
0929 22:48:22.398488 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:22.398535 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":65,"threads_started":1}
I20260929 22:48:22.420948 27738 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:22.421141 27738 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:22.421432 27738 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
W20260929 22:48:22.421746 27342 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
W20260929 22:48:22.421844 27343 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:22.421950 27343 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d47c39957214c08827484c6820071fd; no voters: b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570
I20260929 22:48:22.422042 27738 raft_consensus.cc:2726] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:48:23.236846 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:23.236627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:53929)
0929 22:48:23.236764 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:23.236801 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":63,"threads_started":1}
I20260929 22:48:23.279925 27740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:23.279702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:36689)
0929 22:48:23.279842 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:23.279882 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260929 22:48:23.399228 27741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:23.399015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:48255)
0929 22:48:23.399150 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:23.399186 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":60,"threads_started":1}
I20260929 22:48:24.237733 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:24.237516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:55073)
0929 22:48:24.237644 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:24.237684 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260929 22:48:24.280586 27743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:24.280327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:34497)
0929 22:48:24.280497 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:24.280538 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":112,"threads_started":1}
I20260929 22:48:24.399927 27744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:24.399733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:43463)
0929 22:48:24.399847 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:24.399885 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260929 22:48:24.634150 27745 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:24.634243 27745 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:24.634466 27745 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
W20260929 22:48:24.634948 27343 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
W20260929 22:48:24.635042 27342 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:24.635103 27342 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d47c39957214c08827484c6820071fd; no voters: b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570
I20260929 22:48:24.635170 27745 raft_consensus.cc:2726] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:48:25.238490 27746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:25.238234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:46287)
0929 22:48:25.238390 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:25.238439 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":64,"threads_started":1}
I20260929 22:48:25.281243 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:25.281015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:51141)
0929 22:48:25.281158 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:25.281199 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":60,"threads_started":1}
I20260929 22:48:25.400604 27748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:25.400388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:37123)
0929 22:48:25.400508 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:25.400550 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260929 22:48:26.239195 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:26.238973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:58103)
0929 22:48:26.239110 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:26.239147 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":62,"threads_started":1}
I20260929 22:48:26.281934 27750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:26.281690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:37447)
0929 22:48:26.281825 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:26.281891 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":62,"threads_started":1}
I20260929 22:48:26.401371 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:26.401145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:33593)
0929 22:48:26.401284 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:26.401325 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":63,"threads_started":1}
I20260929 22:48:26.602320 27752 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:26.602416 27752 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:26.602625 27752 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
W20260929 22:48:26.603077 27342 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
W20260929 22:48:26.603169 27343 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:26.603219 27343 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d47c39957214c08827484c6820071fd; no voters: b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570
I20260929 22:48:26.603307 27752 raft_consensus.cc:2726] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:48:27.240113 27753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:27.239866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:38061)
0929 22:48:27.240019 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:27.240063 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
I20260929 22:48:27.282737 27754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:27.282476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:45483)
0929 22:48:27.282643 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:27.282689 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
I20260929 22:48:27.402139 27755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:27.401880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:43763)
0929 22:48:27.402037 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:27.402087 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":62,"threads_started":1}
I20260929 22:48:28.240984 27756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:28.240613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:43901)
0929 22:48:28.240811 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:28.240912 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":78,"threads_started":1}
I20260929 22:48:28.283604 27757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:28.283321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:33521)
0929 22:48:28.283524 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:28.283560 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":127,"threads_started":1}
I20260929 22:48:28.402842 27758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:28.402639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:36343)
0929 22:48:28.402760 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:28.402798 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260929 22:48:29.241868 27759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:29.241594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:34037)
0929 22:48:29.241756 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:29.241818 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
I20260929 22:48:29.284334 27760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:29.284132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:59537)
0929 22:48:29.284249 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:29.284288 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260929 22:48:29.329994 27761 raft_consensus.cc:482] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:29.330089 27761 raft_consensus.cc:504] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d229de32c5ff473f983900f9945db570" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38977 } } peers { permanent_uuid: "b3cbcb809a0d49d082d49869383a589a" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 38245 } } peers { permanent_uuid: "9d47c39957214c08827484c6820071fd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 32785 } }
I20260929 22:48:29.330259 27761 leader_election.cc:288] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d229de32c5ff473f983900f9945db570 (127.12.27.131:38977), b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245)
W20260929 22:48:29.330678 27343 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3cbcb809a0d49d082d49869383a589a (127.12.27.130:38245): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
W20260929 22:48:29.330766 27342 leader_election.cc:341] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d229de32c5ff473f983900f9945db570 (127.12.27.131:38977): Not found: Tablet not found: 2f85704e03ee4d15877faa54a4edfe8a
I20260929 22:48:29.330834 27342 leader_election.cc:302] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d47c39957214c08827484c6820071fd; no voters: b3cbcb809a0d49d082d49869383a589a, d229de32c5ff473f983900f9945db570
I20260929 22:48:29.330914 27761 raft_consensus.cc:2726] T 2f85704e03ee4d15877faa54a4edfe8a P 9d47c39957214c08827484c6820071fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:48:29.403779 27762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:29.403463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:57969)
0929 22:48:29.403608 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:29.403728 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260929 22:48:30.242606 27763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:30.242370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:38753)
0929 22:48:30.242510 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:30.242557 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260929 22:48:30.285063 27764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:30.284779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:57121)
0929 22:48:30.284918 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:30.285017 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260929 22:48:30.404430 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:30.404245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:33197)
0929 22:48:30.404355 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:30.404386 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":55,"threads_started":1}
I20260929 22:48:31.243546 27766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:31.243244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:46823)
0929 22:48:31.243442 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:31.243496 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":125,"threads_started":1}
I20260929 22:48:31.285833 27767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:31.285580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:37717)
0929 22:48:31.285733 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:31.285774 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":64,"threads_started":1}
I20260929 22:48:31.405300 27768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:31.405022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:51231)
0929 22:48:31.405182 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:31.405243 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260929 22:48:32.244432 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:32.244173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:42737)
0929 22:48:32.244315 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:32.244354 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260929 22:48:32.286598 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:32.286361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:60119)
0929 22:48:32.286508 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:32.286553 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260929 22:48:32.406093 27771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:32.405839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:55417)
0929 22:48:32.406006 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:32.406051 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260929 22:48:33.245146 27772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:33.244927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:55769)
0929 22:48:33.245063 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:33.245099 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260929 22:48:33.287303 27773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:33.287092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:53123)
0929 22:48:33.287219 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:33.287258 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260929 22:48:33.406883 27774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:33.406646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:41921)
0929 22:48:33.406799 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:33.406839 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":81,"threads_started":1}
I20260929 22:48:34.245951 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:34.245686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.129:47037)
0929 22:48:34.245862 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:34.245904 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":63,"threads_started":1}
I20260929 22:48:34.288112 27776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:34.287886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.130:35981)
0929 22:48:34.288008 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:34.288049 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260929 22:48:34.403532 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 27295
I20260929 22:48:34.407609 27777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:34.407422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:41203 (local address 127.12.27.131:42245)
0929 22:48:34.407537 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:34.407571 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:41203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260929 22:48:34.408402 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 27457
I20260929 22:48:34.412860 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 27591
2026-09-29T22:48:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18456 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:48:34 dist-test-slave-00d6 krb5kdc[27780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:48:34 dist-test-slave-00d6 krb5kdc[27780](info): set up 2 sockets
Sep 29 22:48:34 dist-test-slave-00d6 krb5kdc[27780](info): commencing operation
krb5kdc: starting...
W20260929 22:48:35.448273 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:48:35 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:48:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:48:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:48:35.567215 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40913
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:40913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:35.648519 27793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:35.648764 27793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:35.648799 27793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:35.649976 27793 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 22:48:35.650043 27793 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 22:48:35.650063 27793 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 22:48:35.650090 27793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:35.650120 27793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:35.650146 27793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:35.650194 27793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:35.650225 27793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:35.651808 27793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:40913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:35.652087 27793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:35.652333 27793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:48:35.657703 27793 server_base.cc:1034] running on GCE node
W20260929 22:48:35.657680 27801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:35.657667 27798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:35.657670 27799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:35.658262 27793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:35.658608 27793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:35.659789 27793 hybrid_clock.cc:648] HybridClock initialized: now 1790722115659763 us; error 36 us; skew 500 ppm
Sep 29 22:48:35 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:35.662562 27793 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:35.663043 27793 webserver.cc:460] Webserver started at http://127.12.27.190:38483/ using document root <none> and password file <none>
I20260929 22:48:35.663300 27793 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:35.663384 27793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:35.663548 27793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:35.664810 27793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "4f9238435797427481f1e532b9069759"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "9ad5d730166593de76a66da74c435beb"
server_key_iv: "cc1eead2d9f794147d5e2e6940a3d33a"
server_key_version: "encryptionkey@0"
I20260929 22:48:35.665206 27793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "4f9238435797427481f1e532b9069759"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "9ad5d730166593de76a66da74c435beb"
server_key_iv: "cc1eead2d9f794147d5e2e6940a3d33a"
server_key_version: "encryptionkey@0"
I20260929 22:48:35.666630 27793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:48:35.667433 27808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:35.667666 27793 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:35.667788 27793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "4f9238435797427481f1e532b9069759"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "9ad5d730166593de76a66da74c435beb"
server_key_iv: "cc1eead2d9f794147d5e2e6940a3d33a"
server_key_version: "encryptionkey@0"
I20260929 22:48:35.667878 27793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:35.685215 27793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:35.687181 27793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:35.687376 27793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:35.691805 27793 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:40913
I20260929 22:48:35.691856 27860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:40913 every 8 connection(s)
I20260929 22:48:35.692261 27793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:35.693128 27861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:35.695389 27861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap starting.
I20260929 22:48:35.696038 27861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:35.696334 27861 log.cc:824] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:35.696997 27861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: No bootstrap required, opened a new log
I20260929 22:48:35.698575 27861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:35.698709 27861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:35.698731 27861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f9238435797427481f1e532b9069759, State: Initialized, Role: FOLLOWER
I20260929 22:48:35.698905 27861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:35.698967 27861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:35.698988 27861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:35.699051 27861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:35.699575 27861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:35.699723 27861 leader_election.cc:302] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f9238435797427481f1e532b9069759; no voters:
I20260929 22:48:35.699905 27861 leader_election.cc:288] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:48:35.699970 27864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:35.700138 27864 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 LEADER]: Becoming Leader. State: Replica: 4f9238435797427481f1e532b9069759, State: Running, Role: LEADER
I20260929 22:48:35.700162 27861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:35.700273 27864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:35.701000 27866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f9238435797427481f1e532b9069759. Latest consensus state: current_term: 1 leader_uuid: "4f9238435797427481f1e532b9069759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } } }
I20260929 22:48:35.701105 27866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:35.701267 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f9238435797427481f1e532b9069759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } } }
I20260929 22:48:35.701335 27873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:35.701346 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:35.701845 27873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:35.702284 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27793
I20260929 22:48:35.702394 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:48:35.702602 12398 external_mini_cluster.cc:1428] Setting key b0fffd1a3c4fb9f45c8c478d666971c1
I20260929 22:48:35.704066 27873 catalog_manager.cc:1347] Generated new cluster ID: 2560f0bd5c9c45b391ce7effffc78623
I20260929 22:48:35.704118 27873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:48:35 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:35.718825 27883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:35.703257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53744 (local address 127.12.27.190:40913)
0929 22:48:35.703419 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:35.703428 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:35.707906 (+ 4478us) server_negotiation.cc:407] Connection header received
0929 22:48:35.708080 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:35.708089 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:35.708163 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:35.708322 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:35.709018 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:35.710501 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:35.711520 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:35.712170 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:35.712288 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:35.715112 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:35.715116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:35.715116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:35.715129 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:35.717123 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:35.717539 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:35.717542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:35.717542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:35.717660 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:35.717868 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:35.717868 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:35.717869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:35.718188 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:35.718334 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:35.718459 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 22:48:35.718591 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260929 22:48:35.725073 27873 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:48:35.725813 27873 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:35.729408 27873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Generated new TSK 0
I20260929 22:48:35.729581 27873 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:48:35.755203 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40913
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:35.840763 27887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:35.840986 27887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:35.841012 27887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:35.842278 27887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:35.842324 27887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:35.842352 27887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:35.844056 27887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:35.844310 27887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:35.844573 27887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:35.850149 27892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:35.850189 27893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:35.850189 27895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:35.850482 27887 server_base.cc:1034] running on GCE node
I20260929 22:48:35.850700 27887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:35.850942 27887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:35.852079 27887 hybrid_clock.cc:648] HybridClock initialized: now 1790722115852071 us; error 32 us; skew 500 ppm
Sep 29 22:48:35 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:35.854674 27887 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:35.855098 27887 webserver.cc:460] Webserver started at http://127.12.27.129:42053/ using document root <none> and password file <none>
I20260929 22:48:35.855329 27887 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:35.855396 27887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:35.855551 27887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:35.856614 27887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "608be70f239e400d9470641cdd5cd3fc"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "0893eda8eede8fb8dcb3f0b2e2b50f12"
server_key_iv: "54a29190f1c6b6c05e8fe9ff3ef8863b"
server_key_version: "encryptionkey@0"
I20260929 22:48:35.856972 27887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "608be70f239e400d9470641cdd5cd3fc"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "0893eda8eede8fb8dcb3f0b2e2b50f12"
server_key_iv: "54a29190f1c6b6c05e8fe9ff3ef8863b"
server_key_version: "encryptionkey@0"
I20260929 22:48:35.858237 27887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:48:35.858995 27902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:35.859200 27887 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:35.859297 27887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "608be70f239e400d9470641cdd5cd3fc"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "0893eda8eede8fb8dcb3f0b2e2b50f12"
server_key_iv: "54a29190f1c6b6c05e8fe9ff3ef8863b"
server_key_version: "encryptionkey@0"
I20260929 22:48:35.859375 27887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:35.867029 27887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:35.869086 27887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:35.869247 27887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:35.869486 27887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:35.869822 27887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:35.869864 27887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:35.869922 27887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:35.869995 27887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:35.876801 27887 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:41817
I20260929 22:48:35.876844 28015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:41817 every 8 connection(s)
I20260929 22:48:35.877219 27887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:35.880091 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 27887
I20260929 22:48:35.880211 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:48:35.880420 12398 external_mini_cluster.cc:1428] Setting key 22b9c782c4f4a592f699da98c89f2538
Sep 29 22:48:35 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:35.888058 27883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:35.877990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:58285 (local address 127.12.27.190:40913)
0929 22:48:35.878048 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:35.878050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:35.878331 (+ 281us) server_negotiation.cc:407] Connection header received
0929 22:48:35.878764 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:35.878765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:35.878781 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:35.878849 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:35.879901 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:35.880702 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:35.881950 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:35.882292 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:35.882370 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:35.885002 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:35.885004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:35.885004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:35.885011 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:35.886540 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:35.887036 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:35.887037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:35.887037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:35.887089 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:35.887381 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:35.887381 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:35.887381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:35.887488 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:35.887541 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:35.887914 (+ 373us) server_negotiation.cc:299] Negotiation successful
0929 22:48:35.887987 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:48:35.888384 28018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:35.877964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:58285)
0929 22:48:35.878134 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:35.878177 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:35.878667 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:35.878905 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:35.878908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:35.879509 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:35.879780 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:35.879786 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:35.881013 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:35.881014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:35.881851 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:35.881853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:35.882436 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:35.882438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:35.882594 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:35.883117 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:35.883127 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:35.884911 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:35.886627 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:35.886635 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:35.886638 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:35.886955 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:35.887159 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:35.887160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:35.887160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:35.887310 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:35.887560 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:35.887567 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:35.887762 (+ 195us) client_negotiation.cc:769] Sending connection context
0929 22:48:35.887888 (+ 126us) client_negotiation.cc:240] Negotiation successful
0929 22:48:35.888062 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260929 22:48:35.888939 28016 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40913
I20260929 22:48:35.889040 28016 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:35.889232 28016 heartbeater.cc:511] Master 127.12.27.190:40913 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:48:35.889756 27825 ts_manager.cc:194] Registered new tserver with Master: 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817)
I20260929 22:48:35.890375 27825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:58285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:48:35.906708 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40913
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:35.995895 28021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:35.996109 28021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:35.996135 28021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:35.997434 28021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:35.997483 28021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:35.997511 28021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:35.999136 28021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:35.999399 28021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:35.999663 28021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:36.004921 28027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:36.004931 28026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:36.004947 28029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:36.005119 28021 server_base.cc:1034] running on GCE node
I20260929 22:48:36.005321 28021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:36.005584 28021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:36.006747 28021 hybrid_clock.cc:648] HybridClock initialized: now 1790722116006737 us; error 43 us; skew 500 ppm
Sep 29 22:48:36 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722116, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:36.009413 28021 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:36.009822 28021 webserver.cc:460] Webserver started at http://127.12.27.130:40263/ using document root <none> and password file <none>
I20260929 22:48:36.010054 28021 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:36.010123 28021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:36.010272 28021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:36.011308 28021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "4910fb3a992f4df3916578f4109a9996"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "cd9b06234a4c2f67acf22d6491117729"
server_key_iv: "cf5a4dcd4fd826758a9bb0c6a19ab7fe"
server_key_version: "encryptionkey@0"
I20260929 22:48:36.011732 28021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "4910fb3a992f4df3916578f4109a9996"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "cd9b06234a4c2f67acf22d6491117729"
server_key_iv: "cf5a4dcd4fd826758a9bb0c6a19ab7fe"
server_key_version: "encryptionkey@0"
I20260929 22:48:36.013031 28021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:48:36.013768 28036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:36.013942 28021 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:48:36.014038 28021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "4910fb3a992f4df3916578f4109a9996"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "cd9b06234a4c2f67acf22d6491117729"
server_key_iv: "cf5a4dcd4fd826758a9bb0c6a19ab7fe"
server_key_version: "encryptionkey@0"
I20260929 22:48:36.014130 28021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:36.023855 28021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:36.026118 28021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:36.026278 28021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:36.026511 28021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:36.026818 28021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:36.026875 28021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:36.026916 28021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:36.026943 28021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:36.032774 28021 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:37811
I20260929 22:48:36.032822 28149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:37811 every 8 connection(s)
I20260929 22:48:36.033124 28021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:48:36 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722116, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:36.041590 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28021
I20260929 22:48:36.041702 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:48:36.041910 12398 external_mini_cluster.cc:1428] Setting key e7b12c096066054d86d8074ebb3b5d03
I20260929 22:48:36.042276 27883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.033814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:35361 (local address 127.12.27.190:40913)
0929 22:48:36.033881 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.033884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.034115 (+ 231us) server_negotiation.cc:407] Connection header received
0929 22:48:36.034568 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.034570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.034579 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.034632 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:36.035535 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.036103 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.037063 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.037248 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.037303 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.039463 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:36.039465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:36.039465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:36.039471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:36.040842 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:36.041194 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:36.041195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:36.041195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:36.041244 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:36.041520 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:36.041521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:36.041521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:36.041670 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:36.041745 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.042096 (+ 351us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.042186 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:48:36.042465 28152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.033791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:35361)
0929 22:48:36.033995 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.034031 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.034488 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.034684 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.034687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.035258 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:36.035456 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.035461 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.036183 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.036184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.036985 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.036987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.037322 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.037323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.037428 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.037951 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:36.037959 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:36.039338 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:36.040919 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:36.040925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:36.040926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:36.041131 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:36.041333 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:36.041333 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:36.041334 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:36.041447 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:36.041750 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:36.041756 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:36.041900 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.042066 (+ 166us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.042221 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":123,"threads_started":1}
I20260929 22:48:36.042943 28150 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40913
I20260929 22:48:36.043020 28150 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:36.043205 28150 heartbeater.cc:511] Master 127.12.27.190:40913 requested a full tablet report, sending...
I20260929 22:48:36.043574 27825 ts_manager.cc:194] Registered new tserver with Master: 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811)
I20260929 22:48:36.044103 27825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:35361
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:48:36.067099 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40913
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:36.146225 28155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:36.146423 28155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:36.146446 28155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:36.147599 28155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:36.147665 28155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:36.147693 28155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:36.149104 28155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:36.149338 28155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:36.149588 28155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:48:36.154531 28155 server_base.cc:1034] running on GCE node
W20260929 22:48:36.154537 28161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:36.154642 28163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:36.154537 28160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:36.154873 28155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:36.155112 28155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:36.156286 28155 hybrid_clock.cc:648] HybridClock initialized: now 1790722116156272 us; error 45 us; skew 500 ppm
Sep 29 22:48:36 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722116, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:36.158776 28155 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:36.159215 28155 webserver.cc:460] Webserver started at http://127.12.27.131:34349/ using document root <none> and password file <none>
I20260929 22:48:36.159451 28155 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:36.159521 28155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:36.159696 28155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:48:36.160698 28155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "69883f1ccd6a42d99036dddfe6da909d"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "795fde2d12b2679efa9b20f375ee85e9"
server_key_iv: "2dcbcb64fb092fe2b2030e28009737d9"
server_key_version: "encryptionkey@0"
I20260929 22:48:36.161063 28155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "69883f1ccd6a42d99036dddfe6da909d"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "795fde2d12b2679efa9b20f375ee85e9"
server_key_iv: "2dcbcb64fb092fe2b2030e28009737d9"
server_key_version: "encryptionkey@0"
I20260929 22:48:36.162474 28155 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:48:36.163216 28170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:36.163398 28155 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:36.163492 28155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "69883f1ccd6a42d99036dddfe6da909d"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "795fde2d12b2679efa9b20f375ee85e9"
server_key_iv: "2dcbcb64fb092fe2b2030e28009737d9"
server_key_version: "encryptionkey@0"
I20260929 22:48:36.163580 28155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:36.175802 28155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:36.178045 28155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:36.178185 28155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:36.178413 28155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:36.178706 28155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:36.178758 28155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:36.178805 28155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:36.178833 28155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:36.184726 28155 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:36131
I20260929 22:48:36.184796 28283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:36131 every 8 connection(s)
I20260929 22:48:36.185112 28155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:48:36 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722116, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:36.191733 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28155
I20260929 22:48:36.191848 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:48:36.192072 12398 external_mini_cluster.cc:1428] Setting key 5375f40738984db4d0b10ad95fc4afc3
I20260929 22:48:36.194155 27883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.185860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:42755 (local address 127.12.27.190:40913)
0929 22:48:36.185939 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.185941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.186110 (+ 169us) server_negotiation.cc:407] Connection header received
0929 22:48:36.186549 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.186551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.186560 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.186615 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:36.187504 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.188080 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.188997 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.189177 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.189233 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.191176 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:36.191178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:36.191178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:36.191184 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:36.192782 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:36.193211 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:36.193212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:36.193212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:36.193274 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:36.193522 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:36.193523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:36.193524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:36.193641 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:36.193717 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.193987 (+ 270us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.194065 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 22:48:36.194348 28286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.185820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:42755)
0929 22:48:36.185992 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.186027 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.186469 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.186683 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.186686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.187231 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:36.187415 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.187419 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.188155 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.188156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.188920 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.188921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.189249 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.189250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.189344 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.189762 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:36.189770 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:36.191090 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:36.192873 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:36.192880 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:36.192882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:36.193135 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:36.193343 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:36.193344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:36.193344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:36.193453 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:36.193708 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:36.193715 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:36.193851 (+ 136us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.193954 (+ 103us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.194119 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
I20260929 22:48:36.194756 28284 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40913
I20260929 22:48:36.194837 28284 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:36.195029 28284 heartbeater.cc:511] Master 127.12.27.190:40913 requested a full tablet report, sending...
I20260929 22:48:36.195400 27825 ts_manager.cc:194] Registered new tserver with Master: 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
I20260929 22:48:36.195843 27825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:42755
I20260929 22:48:36.203953 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:48:36.210822 27883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.205299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53748 (local address 127.12.27.190:40913)
0929 22:48:36.205358 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.205360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.205494 (+ 134us) server_negotiation.cc:407] Connection header received
0929 22:48:36.205530 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.205531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.205539 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.205587 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:36.206112 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.206571 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.207267 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.207436 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.207492 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.208697 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:36.208698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:36.208698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:36.208704 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:36.209847 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:36.210183 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:36.210183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:36.210184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:36.210231 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:36.210426 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:36.210427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:36.210427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:36.210544 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:36.210615 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.210709 (+ 94us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.210762 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:48:36.212615 27825 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53748:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:48:36.214174 27825 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:48:36.220558 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.216407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41817 (local address 127.0.0.1:39954)
0929 22:48:36.216584 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.216592 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.216633 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.216958 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.216963 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.216966 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:36.217032 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.217033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.218187 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.218188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.219456 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.219458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.220231 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.220232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.220319 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.220333 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.220430 (+ 97us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.220484 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":42,"threads_started":1}
I20260929 22:48:36.220569 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.216578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39954 (local address 127.12.27.129:41817)
0929 22:48:36.216753 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.216759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.216770 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:48:36.216812 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.216815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.216830 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.216977 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:36.217152 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.218072 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.219550 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.220147 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.220232 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.220291 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.220454 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.220492 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260929 22:48:36.220834 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.216227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36131 (local address 127.0.0.1:36150)
0929 22:48:36.216574 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.216584 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.216633 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.217296 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.217297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.217299 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:36.217346 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.217348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.218696 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.218697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.219702 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.219705 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.220571 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.220572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.220640 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.220644 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.220698 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.220749 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":58,"threads_started":1}
I20260929 22:48:36.220940 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.216194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37811 (local address 127.0.0.1:34404)
0929 22:48:36.216317 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.216356 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.216434 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.217076 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.217077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.217079 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:36.217118 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.217119 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.218503 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.218504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.219552 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.219554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.220687 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.220688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.220759 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.220763 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.220833 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.220870 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":1,"thread_start_us":76,"threads_started":1}
I20260929 22:48:36.220968 28296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.216402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34404 (local address 127.12.27.130:37811)
0929 22:48:36.216788 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.216792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.216801 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:36.216837 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.216838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.216856 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.216943 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:36.217200 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.218391 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.219666 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.220389 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.220468 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.220524 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.220850 (+ 326us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.220893 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":87,"threads_started":1}
I20260929 22:48:36.221086 28294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.216333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.12.27.131:36131)
0929 22:48:36.217077 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.217081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.217090 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:36.217127 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.217129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.217144 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.217222 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:36.217434 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.218600 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.219782 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.220436 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.220494 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.220538 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.220962 (+ 424us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.221004 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":104,"threads_started":1}
I20260929 22:48:36.221606 27950 tablet_service.cc:1467] Processing CreateTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e (DEFAULT_TABLE table=test-table [id=761bd72787784400af5f3f91a426147a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:36.221725 28218 tablet_service.cc:1467] Processing CreateTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e (DEFAULT_TABLE table=test-table [id=761bd72787784400af5f3f91a426147a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:36.221872 27950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ef0018ede964e45b380c1dffaaceb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:36.221963 28218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ef0018ede964e45b380c1dffaaceb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:36.224377 28084 tablet_service.cc:1467] Processing CreateTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e (DEFAULT_TABLE table=test-table [id=761bd72787784400af5f3f91a426147a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:36.224702 28084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ef0018ede964e45b380c1dffaaceb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:36.224731 28299 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Bootstrap starting.
I20260929 22:48:36.224732 28298 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Bootstrap starting.
I20260929 22:48:36.225221 28299 tablet_bootstrap.cc:654] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:36.225343 28298 tablet_bootstrap.cc:654] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:36.225644 28299 log.cc:824] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:36.225884 28298 log.cc:824] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:36.226333 28299 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: No bootstrap required, opened a new log
I20260929 22:48:36.226392 28299 ts_tablet_manager.cc:1397] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:48:36.226595 28298 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: No bootstrap required, opened a new log
I20260929 22:48:36.226649 28298 ts_tablet_manager.cc:1397] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:48:36.227715 28299 raft_consensus.cc:348] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.227919 28299 raft_consensus.cc:374] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:36.227972 28299 raft_consensus.cc:729] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69883f1ccd6a42d99036dddfe6da909d, State: Initialized, Role: FOLLOWER
I20260929 22:48:36.228104 28299 consensus_queue.cc:260] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.228236 28302 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Bootstrap starting.
I20260929 22:48:36.228480 28299 ts_tablet_manager.cc:1428] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:36.228505 28284 heartbeater.cc:503] Master 127.12.27.190:40913 was elected leader, sending a full tablet report...
I20260929 22:48:36.228968 28302 tablet_bootstrap.cc:654] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:36.228994 28298 raft_consensus.cc:348] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.229199 28298 raft_consensus.cc:374] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:36.229270 28298 raft_consensus.cc:729] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608be70f239e400d9470641cdd5cd3fc, State: Initialized, Role: FOLLOWER
I20260929 22:48:36.229382 28298 consensus_queue.cc:260] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.229508 28302 log.cc:824] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:36.229660 28298 ts_tablet_manager.cc:1428] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:48:36.229784 28016 heartbeater.cc:503] Master 127.12.27.190:40913 was elected leader, sending a full tablet report...
I20260929 22:48:36.230295 28302 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: No bootstrap required, opened a new log
I20260929 22:48:36.230363 28302 ts_tablet_manager.cc:1397] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:36.231937 28302 raft_consensus.cc:348] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.232121 28302 raft_consensus.cc:374] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:36.232167 28302 raft_consensus.cc:729] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4910fb3a992f4df3916578f4109a9996, State: Initialized, Role: FOLLOWER
I20260929 22:48:36.232290 28302 consensus_queue.cc:260] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.232542 28302 ts_tablet_manager.cc:1428] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:36.232565 28150 heartbeater.cc:503] Master 127.12.27.190:40913 was elected leader, sending a full tablet report...
W20260929 22:48:36.283694 28151 tablet.cc:2369] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:48:36.310240 28303 raft_consensus.cc:482] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:36.310369 28303 raft_consensus.cc:504] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.310710 28303 leader_election.cc:288] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817)
I20260929 22:48:36.313582 28286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.310921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37811 (local address 127.12.27.131:37005)
0929 22:48:36.311042 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.311057 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.311107 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.311302 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.311303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.311305 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:36.311381 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.311383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.312046 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.312047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.312771 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.312773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.313318 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.313319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.313402 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.313405 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.313467 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.313507 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260929 22:48:36.313582 28296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.311028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:37005 (local address 127.12.27.130:37811)
0929 22:48:36.311095 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.311097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.311109 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:48:36.311191 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.311193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.311203 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.311250 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:36.311466 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.311959 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.312866 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.313236 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.313322 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.313330 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.313485 (+ 155us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.313521 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 22:48:36.313920 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.311227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:58123 (local address 127.12.27.129:41817)
0929 22:48:36.311268 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.311269 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.311326 (+ 57us) server_negotiation.cc:407] Connection header received
0929 22:48:36.311460 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.311461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.311471 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.311547 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:36.311706 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.312179 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.313151 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.313527 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.313609 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.313617 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.313808 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.313864 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:48:36.313963 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef0018ede964e45b380c1dffaaceb5e" candidate_uuid: "69883f1ccd6a42d99036dddfe6da909d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4910fb3a992f4df3916578f4109a9996" is_pre_election: true
I20260929 22:48:36.314141 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.311053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41817 (local address 127.12.27.131:58123)
0929 22:48:36.311263 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.311274 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:36.311352 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:36.311553 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:36.311553 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:36.311555 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:36.311648 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.311651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.312279 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.312280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.313034 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:36.313036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.313624 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.313625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:36.313711 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.313714 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:48:36.314026 (+ 312us) client_negotiation.cc:240] Negotiation successful
0929 22:48:36.314074 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":122,"threads_started":1}
I20260929 22:48:36.314170 28104 raft_consensus.cc:2454] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69883f1ccd6a42d99036dddfe6da909d in term 0.
I20260929 22:48:36.314394 28173 leader_election.cc:302] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d; no voters:
I20260929 22:48:36.314532 28303 raft_consensus.cc:2781] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:48:36.314587 28303 raft_consensus.cc:482] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:48:36.314546 27970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef0018ede964e45b380c1dffaaceb5e" candidate_uuid: "69883f1ccd6a42d99036dddfe6da909d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "608be70f239e400d9470641cdd5cd3fc" is_pre_election: true
I20260929 22:48:36.314636 28303 raft_consensus.cc:3037] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:36.314688 27970 raft_consensus.cc:2454] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69883f1ccd6a42d99036dddfe6da909d in term 0.
I20260929 22:48:36.315388 28303 raft_consensus.cc:504] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.315522 28303 leader_election.cc:288] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [CANDIDATE]: Term 1 election: Requested vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817)
I20260929 22:48:36.315742 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef0018ede964e45b380c1dffaaceb5e" candidate_uuid: "69883f1ccd6a42d99036dddfe6da909d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4910fb3a992f4df3916578f4109a9996"
I20260929 22:48:36.315730 27970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ef0018ede964e45b380c1dffaaceb5e" candidate_uuid: "69883f1ccd6a42d99036dddfe6da909d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "608be70f239e400d9470641cdd5cd3fc"
I20260929 22:48:36.315810 28104 raft_consensus.cc:3037] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:36.315810 27970 raft_consensus.cc:3037] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:36.316673 27970 raft_consensus.cc:2454] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69883f1ccd6a42d99036dddfe6da909d in term 1.
I20260929 22:48:36.316673 28104 raft_consensus.cc:2454] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69883f1ccd6a42d99036dddfe6da909d in term 1.
I20260929 22:48:36.316841 28173 leader_election.cc:302] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d; no voters:
I20260929 22:48:36.316962 28303 raft_consensus.cc:2781] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:36.317097 28303 raft_consensus.cc:686] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 LEADER]: Becoming Leader. State: Replica: 69883f1ccd6a42d99036dddfe6da909d, State: Running, Role: LEADER
I20260929 22:48:36.317166 28303 consensus_queue.cc:237] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:36.318014 27825 catalog_manager.cc:5495] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d reported cstate change: term changed from 0 to 1, leader changed from <none> to 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131). New cstate: current_term: 1 leader_uuid: "69883f1ccd6a42d99036dddfe6da909d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } health_report { overall_health: HEALTHY } } }
I20260929 22:48:36.338557 28294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.336384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36708 (local address 127.12.27.131:36131)
0929 22:48:36.336438 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:36.336441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:36.336512 (+ 71us) server_negotiation.cc:407] Connection header received
0929 22:48:36.336564 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:36.336564 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:36.336580 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:36.336641 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:36.336765 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.337224 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.337919 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:36.338095 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:36.338147 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:36.338288 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:36.338388 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:36.338448 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:36.338486 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 22:48:36.338502 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 22:48:36.340304 27970 raft_consensus.cc:1261] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Refusing update from remote peer 69883f1ccd6a42d99036dddfe6da909d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:36.340327 28104 raft_consensus.cc:1261] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Refusing update from remote peer 69883f1ccd6a42d99036dddfe6da909d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:36.340665 28303 consensus_queue.cc:1035] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [LEADER]: Connected to new peer: Peer: permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:36.340842 28308 consensus_queue.cc:1035] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:36.344264 28313 mvcc.cc:205] Tried to move back new op lower bound from 7334797788527259648 to 7334797788435804160. Current Snapshot: MvccSnapshot[applied={T|T < 7334797788527259648}]
I20260929 22:48:36.345346 27824 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:36.345451 27824 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:36.346240 27824 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Sending DeleteTablet for 3 replicas of tablet 8ef0018ede964e45b380c1dffaaceb5e
I20260929 22:48:36.346598 28084 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:34404
I20260929 22:48:36.346629 27950 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:39954
I20260929 22:48:36.346675 28218 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:36150
I20260929 22:48:36.346830 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 27887
I20260929 22:48:36.346832 28320 tablet_replica.cc:330] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: stopping tablet replica
I20260929 22:48:36.346933 28320 raft_consensus.cc:2229] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:36.347011 28320 raft_consensus.cc:2258] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:36.348850 28320 ts_tablet_manager.cc:1905] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:36.350914 28320 ts_tablet_manager.cc:1918] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:36.351017 28320 log.cc:1196] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/8ef0018ede964e45b380c1dffaaceb5e
I20260929 22:48:36.351318 28320 ts_tablet_manager.cc:1939] T 8ef0018ede964e45b380c1dffaaceb5e P 4910fb3a992f4df3916578f4109a9996: Deleting consensus metadata
W20260929 22:48:36.351787 27811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:41817 (error 108)
I20260929 22:48:36.352000 28322 tablet_replica.cc:330] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: stopping tablet replica
I20260929 22:48:36.352028 27811 catalog_manager.cc:4841] TS 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): tablet 8ef0018ede964e45b380c1dffaaceb5e (table test-table [id=761bd72787784400af5f3f91a426147a]) successfully deleted
I20260929 22:48:36.352094 28322 raft_consensus.cc:2229] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:48:36.352165 28322 raft_consensus.cc:2258] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:36.352332 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.352177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41817 (local address 127.0.0.1:56422)
0929 22:48:36.352240 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.352295 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:41817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260929 22:48:36.352370 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28021
W20260929 22:48:36.352504 27811 catalog_manager.cc:4584] TS 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ef0018ede964e45b380c1dffaaceb5e: Network error: Client connection negotiation failed: client connection to 127.12.27.129:41817: connect: Connection refused (error 111)
I20260929 22:48:36.358326 28322 ts_tablet_manager.cc:1905] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:36.358371 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28155
I20260929 22:48:36.362846 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 27793
I20260929 22:48:36.362883 28293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:36.362749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36131 (local address 127.0.0.1:36710)
0929 22:48:36.362809 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:36.362843 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.131:36131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:48:56.369078 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40913
--webserver_interface=127.12.27.190
--webserver_port=38483
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:40913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:48:56.448992 28324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:56.449190 28324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:56.449211 28324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:56.450285 28324 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 22:48:56.450321 28324 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 22:48:56.450335 28324 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 22:48:56.450374 28324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:48:56.450388 28324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:56.450409 28324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:56.450423 28324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:48:56.450440 28324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:48:56.451848 28324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:40913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=38483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:56.452028 28324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:56.452209 28324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:56.460637 28331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.460657 28333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:56.460803 28324 server_base.cc:1034] running on GCE node
W20260929 22:48:56.460886 28330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:56.461140 28324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:56.461411 28324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:56.462551 28324 hybrid_clock.cc:648] HybridClock initialized: now 1790722136462537 us; error 26 us; skew 500 ppm
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:56.465122 28324 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:48:56.465534 28324 webserver.cc:460] Webserver started at http://127.12.27.190:38483/ using document root <none> and password file <none>
I20260929 22:48:56.465720 28324 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:56.465770 28324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:56.467077 28324 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.467767 28340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.467926 28324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:56.468015 28324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "4f9238435797427481f1e532b9069759"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "9ad5d730166593de76a66da74c435beb"
server_key_iv: "cc1eead2d9f794147d5e2e6940a3d33a"
server_key_version: "encryptionkey@0"
I20260929 22:48:56.468406 28324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:56.484426 28324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:56.486740 28324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:56.486853 28324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:56.490746 28324 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:40913
I20260929 22:48:56.490828 28392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:40913 every 8 connection(s)
I20260929 22:48:56.491191 28324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:48:56.492748 28393 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:48:56.493410 28393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap starting.
I20260929 22:48:56.493973 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28324
I20260929 22:48:56.494254 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:41817
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:40913
--webserver_port=42053
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:56.502234 28393 log.cc:824] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:56.504281 28393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:56.504662 28393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap complete.
I20260929 22:48:56.506979 28393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:56.507226 28393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f9238435797427481f1e532b9069759, State: Initialized, Role: FOLLOWER
I20260929 22:48:56.507440 28393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:56.507532 28393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:48:56.507591 28393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:48:56.507654 28393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 1 FOLLOWER]: Advancing to term 2
I20260929 22:48:56.508631 28393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:56.508749 28393 leader_election.cc:302] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f9238435797427481f1e532b9069759; no voters:
I20260929 22:48:56.508948 28393 leader_election.cc:288] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 22:48:56.508982 28397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 22:48:56.509097 28397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 LEADER]: Becoming Leader. State: Replica: 4f9238435797427481f1e532b9069759, State: Running, Role: LEADER
I20260929 22:48:56.509215 28393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:48:56.509243 28397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:48:56.509495 28397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f9238435797427481f1e532b9069759. Latest consensus state: current_term: 2 leader_uuid: "4f9238435797427481f1e532b9069759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } } }
I20260929 22:48:56.509557 28397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:56.509744 28398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4f9238435797427481f1e532b9069759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } } }
I20260929 22:48:56.509939 28398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: This master's current role is: LEADER
I20260929 22:48:56.509760 28401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:48:56.510761 28401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:48:56.511009 28401 catalog_manager.cc:1259] Loaded cluster ID: 2560f0bd5c9c45b391ce7effffc78623
I20260929 22:48:56.511101 28401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:48:56.512342 28401 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:48:56.512522 28401 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Loaded TSK: 0
I20260929 22:48:56.522250 28401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Generated new TSK 1
I20260929 22:48:56.522356 28401 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 22:48:56.583588 28395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:56.583909 28395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:56.583946 28395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:56.585613 28395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:56.585673 28395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:56.585714 28395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:48:56.587786 28395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:41817
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=42053
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:56.588047 28395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:56.588291 28395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:56.593487 28420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.593518 28423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.593573 28421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:56.593761 28395 server_base.cc:1034] running on GCE node
I20260929 22:48:56.593986 28395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:56.594249 28395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:56.595405 28395 hybrid_clock.cc:648] HybridClock initialized: now 1790722136595382 us; error 39 us; skew 500 ppm
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:56.598203 28395 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:48:56.598763 28395 webserver.cc:460] Webserver started at http://127.12.27.129:42053/ using document root <none> and password file <none>
I20260929 22:48:56.599042 28395 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:56.599125 28395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:56.600971 28395 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.601739 28430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.601936 28395 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.602032 28395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "608be70f239e400d9470641cdd5cd3fc"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "0893eda8eede8fb8dcb3f0b2e2b50f12"
server_key_iv: "54a29190f1c6b6c05e8fe9ff3ef8863b"
server_key_version: "encryptionkey@0"
I20260929 22:48:56.602486 28395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:56.627019 28395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:56.629544 28395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:56.629702 28395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:56.629967 28395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:56.630476 28437 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:48:56.631978 28395 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:48:56.632037 28395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:48:56.632072 28395 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:48:56.632962 28395 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:48:56.633009 28395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:56.633088 28437 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Bootstrap starting.
I20260929 22:48:56.639477 28395 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:41817
I20260929 22:48:56.639798 28544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:41817 every 8 connection(s)
I20260929 22:48:56.639915 28395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:48:56.640954 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28395
I20260929 22:48:56.641237 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:37811
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:40913
--webserver_port=40263
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:56.644215 28437 log.cc:824] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:56.648550 28437 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:56.648981 28437 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Bootstrap complete.
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:56.650695 28437 ts_tablet_manager.cc:1397] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.008s
I20260929 22:48:56.652697 28437 raft_consensus.cc:348] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.653185 28437 raft_consensus.cc:729] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608be70f239e400d9470641cdd5cd3fc, State: Initialized, Role: FOLLOWER
I20260929 22:48:56.653394 28437 consensus_queue.cc:260] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.653651 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.640565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:48389)
0929 22:48:56.640765 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:56.640823 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:56.641898 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:56.642711 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:56.642716 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:56.643052 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:56.643307 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.643313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.645019 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.645020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.646237 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.646240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.647064 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.647066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.647202 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.647849 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:56.647859 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:56.649761 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:56.651982 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.651988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.651990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.652269 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.652551 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.652552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.652552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.652661 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.653063 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:56.653068 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:56.653194 (+ 126us) client_negotiation.cc:769] Sending connection context
0929 22:48:56.653271 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:48:56.653450 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":94,"threads_started":1}
I20260929 22:48:56.654081 28437 ts_tablet_manager.cc:1428] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:48:56.654310 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.640688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:48389 (local address 127.12.27.190:40913)
0929 22:48:56.642179 (+ 1491us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.642194 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.642244 (+ 50us) server_negotiation.cc:407] Connection header received
0929 22:48:56.642399 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.642405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.642471 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.642681 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:56.643455 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.644882 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.646350 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.646940 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.647480 (+ 540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.649885 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:56.649889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:56.649889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:56.649901 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:56.651887 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.652357 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.652360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.652360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.652479 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.652729 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.652730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.652730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.652990 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:56.653909 (+ 919us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.653994 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.654128 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1428,"thread_start_us":92,"threads_started":1}
I20260929 22:48:56.654834 28545 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40913
I20260929 22:48:56.654934 28545 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:56.655097 28545 heartbeater.cc:511] Master 127.12.27.190:40913 requested a full tablet report, sending...
I20260929 22:48:56.656828 28357 ts_manager.cc:194] Registered new tserver with Master: 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817)
I20260929 22:48:56.657922 28357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:48389
I20260929 22:48:56.659387 28545 heartbeater.cc:503] Master 127.12.27.190:40913 was elected leader, sending a full tablet report...
I20260929 22:48:56.663769 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.658675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.12.27.129:41817)
0929 22:48:56.660508 (+ 1833us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.660512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.660521 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:56.660546 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.660547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.660559 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.660628 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:56.660814 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.661468 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.662936 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.663363 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.663418 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.663452 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.663683 (+ 231us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.663723 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1804,"thread_start_us":62,"threads_started":1}
I20260929 22:48:56.663774 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.658477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41817 (local address 127.0.0.1:48178)
0929 22:48:56.658620 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:56.658661 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:56.658725 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:56.660658 (+ 1933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:56.660661 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:56.660664 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:56.660725 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.660727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.661538 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.661539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.662838 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.662841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.663440 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.663441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.663525 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.663538 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:48:56.663622 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:48:56.663698 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260929 22:48:56.664230 28479 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:48178
I20260929 22:48:56.664799 28554 tablet_replica.cc:330] stopping tablet replica
I20260929 22:48:56.664916 28554 raft_consensus.cc:2229] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:56.664994 28554 raft_consensus.cc:2258] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:56.665284 28554 ts_tablet_manager.cc:1905] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:56.667479 28554 ts_tablet_manager.cc:1918] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:56.667567 28554 log.cc:1196] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal/wals/8ef0018ede964e45b380c1dffaaceb5e
I20260929 22:48:56.667820 28554 ts_tablet_manager.cc:1939] T 8ef0018ede964e45b380c1dffaaceb5e P 608be70f239e400d9470641cdd5cd3fc: Deleting consensus metadata
I20260929 22:48:56.668278 28343 catalog_manager.cc:4841] TS 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817): tablet 8ef0018ede964e45b380c1dffaaceb5e (table test-table [id=761bd72787784400af5f3f91a426147a]) successfully deleted
W20260929 22:48:56.728539 28549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:56.728744 28549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:56.728767 28549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:56.729841 28549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:56.729874 28549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:56.729899 28549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:48:56.731266 28549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:37811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=40263
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:56.731446 28549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:56.731616 28549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:56.736599 28559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.736618 28560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.736613 28562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:56.736778 28549 server_base.cc:1034] running on GCE node
I20260929 22:48:56.737025 28549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:56.737268 28549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:56.738431 28549 hybrid_clock.cc:648] HybridClock initialized: now 1790722136738423 us; error 45 us; skew 500 ppm
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:56.740897 28549 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:48:56.741333 28549 webserver.cc:460] Webserver started at http://127.12.27.130:40263/ using document root <none> and password file <none>
I20260929 22:48:56.741541 28549 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:56.741595 28549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:56.742874 28549 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.743417 28569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.743566 28549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:48:56.743686 28549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "4910fb3a992f4df3916578f4109a9996"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "cd9b06234a4c2f67acf22d6491117729"
server_key_iv: "cf5a4dcd4fd826758a9bb0c6a19ab7fe"
server_key_version: "encryptionkey@0"
I20260929 22:48:56.744029 28549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:56.761312 28549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:56.763345 28549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:56.763484 28549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:56.763741 28549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:56.764047 28549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:48:56.764078 28549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.764130 28549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:48:56.764158 28549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.769651 28549 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:37811
I20260929 22:48:56.769754 28682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:37811 every 8 connection(s)
I20260929 22:48:56.770073 28549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:56.777330 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28549
I20260929 22:48:56.777650 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:36131
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:40913
--webserver_port=34349
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:48:56.779309 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.770811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:60375 (local address 127.12.27.190:40913)
0929 22:48:56.770898 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.770900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.771125 (+ 225us) server_negotiation.cc:407] Connection header received
0929 22:48:56.771599 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.771600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.771613 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.771731 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:56.772708 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.773211 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.774154 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.774374 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.774430 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.776479 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:56.776481 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:56.776481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:56.776489 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:56.777945 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.778339 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.778340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.778340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.778399 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.778647 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.778648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.778648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.778763 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:56.778835 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.779120 (+ 285us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.779216 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:48:56.779471 28685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.770783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:60375)
0929 22:48:56.770969 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:56.771004 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:56.771509 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:56.771824 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:56.771828 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:56.772424 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:56.772611 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.772616 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.773292 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.773292 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.774073 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.774074 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.774450 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.774451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.774547 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.774985 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:56.774993 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:56.776377 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:56.778025 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.778032 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.778034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.778252 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.778467 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.778468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.778468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.778578 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.778836 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:56.778843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:56.778980 (+ 137us) client_negotiation.cc:769] Sending connection context
0929 22:48:56.779083 (+ 103us) client_negotiation.cc:240] Negotiation successful
0929 22:48:56.779234 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260929 22:48:56.779973 28683 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40913
I20260929 22:48:56.780083 28683 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:56.780254 28683 heartbeater.cc:511] Master 127.12.27.190:40913 requested a full tablet report, sending...
I20260929 22:48:56.780678 28357 ts_manager.cc:194] Registered new tserver with Master: 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811)
I20260929 22:48:56.781137 28357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:60375
W20260929 22:48:56.858806 28686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:48:56.858992 28686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:48:56.859015 28686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:48:56.860220 28686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:48:56.860260 28686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:48:56.860312 28686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:48:56.861833 28686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:36131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=34349
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:48:56.862056 28686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:48:56.862413 28686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:48:56.867518 28691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.867527 28692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:48:56.867516 28694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:48:56.867570 28686 server_base.cc:1034] running on GCE node
I20260929 22:48:56.867981 28686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:48:56.868175 28686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:48:56.869306 28686 hybrid_clock.cc:648] HybridClock initialized: now 1790722136869292 us; error 30 us; skew 500 ppm
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:48:56.871809 28686 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:48:56.872263 28686 webserver.cc:460] Webserver started at http://127.12.27.131:34349/ using document root <none> and password file <none>
I20260929 22:48:56.872524 28686 fs_manager.cc:359] Metadata directory not provided
I20260929 22:48:56.872606 28686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:48:56.873898 28686 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.874552 28701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.874766 28686 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.874869 28686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "69883f1ccd6a42d99036dddfe6da909d"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "795fde2d12b2679efa9b20f375ee85e9"
server_key_iv: "2dcbcb64fb092fe2b2030e28009737d9"
server_key_version: "encryptionkey@0"
I20260929 22:48:56.875185 28686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:48:56.916563 28686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:48:56.918740 28686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:48:56.918949 28686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:48:56.919225 28686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:48:56.919849 28708 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:48:56.921343 28686 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:48:56.921402 28686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:48:56.921429 28686 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:48:56.922089 28686 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:48:56.922138 28686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:56.922191 28708 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Bootstrap starting.
I20260929 22:48:56.924381 28708 log.cc:824] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:56.928011 28708 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:48:56.928385 28708 tablet_bootstrap.cc:492] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Bootstrap complete.
I20260929 22:48:56.928577 28708 ts_tablet_manager.cc:1397] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260929 22:48:56.929994 28686 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:36131
I20260929 22:48:56.930028 28816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:36131 every 8 connection(s)
I20260929 22:48:56.930397 28686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:48:56.930935 28708 raft_consensus.cc:348] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.931368 28708 raft_consensus.cc:729] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69883f1ccd6a42d99036dddfe6da909d, State: Initialized, Role: FOLLOWER
I20260929 22:48:56.931515 28708 consensus_queue.cc:260] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.931813 28708 ts_tablet_manager.cc:1428] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260929 22:48:56.933272 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28686
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:48:56.941603 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.933713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52334 (local address 127.12.27.190:40913)
0929 22:48:56.933826 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.933827 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.933939 (+ 112us) server_negotiation.cc:407] Connection header received
0929 22:48:56.934024 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.934025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.934034 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.934088 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:56.934846 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.935504 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.936779 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.936973 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.937030 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.938464 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:56.938466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:56.938466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:56.938473 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:56.940421 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.940802 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.940803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.940804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.940864 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.941079 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.941080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.941080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.941194 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:56.941382 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.941417 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.941496 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":65,"threads_started":1}
I20260929 22:48:56.941917 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.931198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:36821 (local address 127.12.27.190:40913)
0929 22:48:56.931281 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.931284 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.931505 (+ 221us) server_negotiation.cc:407] Connection header received
0929 22:48:56.931761 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.931763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.931776 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.931823 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:56.932594 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.933142 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.934907 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.935200 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.935270 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.938550 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:56.938551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:56.938551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:56.938558 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:56.940219 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.940718 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.940719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.940719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.940779 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.941041 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.941042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.941042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.941159 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:56.941259 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.941545 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.941635 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 22:48:56.942032 28819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.931106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:36821)
0929 22:48:56.931361 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:56.931407 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:56.931577 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:56.932008 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:56.932011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:56.932308 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:56.932506 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.932510 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.933308 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.933309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.934833 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.934835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.935334 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.935335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.935442 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.936018 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:56.936030 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:56.938455 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:56.940313 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.940320 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.940323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.940627 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.940850 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.940851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.940851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.940972 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.941255 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:56.941261 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:56.941412 (+ 151us) client_negotiation.cc:769] Sending connection context
0929 22:48:56.941524 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 22:48:56.941801 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":84,"threads_started":1}
I20260929 22:48:56.942420 28817 heartbeater.cc:347] Connected to a master server at 127.12.27.190:40913
I20260929 22:48:56.942531 28817 heartbeater.cc:464] Registering TS with master...
I20260929 22:48:56.942703 28817 heartbeater.cc:511] Master 127.12.27.190:40913 requested a full tablet report, sending...
I20260929 22:48:56.943243 28357 ts_manager.cc:194] Registered new tserver with Master: 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
I20260929 22:48:56.943883 28357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:36821
I20260929 22:48:56.944574 28817 heartbeater.cc:503] Master 127.12.27.190:40913 was elected leader, sending a full tablet report...
Sep 29 22:48:56 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.131@KRBTEST.COM
I20260929 22:48:56.950668 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.943709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50772 (local address 127.12.27.131:36131)
0929 22:48:56.943884 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.943888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.943896 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:48:56.943922 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.943924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.943954 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.944055 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:56.944438 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.945171 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.945829 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.946143 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.946223 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.948120 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:56.948127 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:56.948127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:56.948133 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:56.949458 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.949850 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.949854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.949854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.949915 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:56.950111 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:56.950111 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:56.950112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:56.950251 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:56.950337 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.950500 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.950586 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":105,"threads_started":1}
I20260929 22:48:56.950664 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.943510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36131 (local address 127.0.0.1:50772)
0929 22:48:56.943559 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:56.943569 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:56.943602 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:56.944060 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:56.944061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:56.944324 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:48:56.944358 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.944359 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.945256 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.945258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.945739 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.945741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.946221 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.946222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.946288 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.946743 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:48:56.946747 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:48:56.948022 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:48:56.949558 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.949565 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.949567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.949756 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.949982 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:48:56.949983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:48:56.949984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:48:56.950048 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:48:56.950328 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:48:56.950334 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:48:56.950383 (+ 49us) client_negotiation.cc:769] Sending connection context
0929 22:48:56.950470 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:48:56.950569 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:48:56.951144 28751 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ef0018ede964e45b380c1dffaaceb5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:36 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:50772
I20260929 22:48:56.951745 28824 tablet_replica.cc:330] stopping tablet replica
I20260929 22:48:56.951830 28824 raft_consensus.cc:2229] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:56.951895 28824 raft_consensus.cc:2258] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:56.952163 28824 ts_tablet_manager.cc:1905] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:56.953143 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:48:56.954893 28824 ts_tablet_manager.cc:1918] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:56.954962 28824 log.cc:1196] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/8ef0018ede964e45b380c1dffaaceb5e
I20260929 22:48:56.955204 28824 ts_tablet_manager.cc:1939] T 8ef0018ede964e45b380c1dffaaceb5e P 69883f1ccd6a42d99036dddfe6da909d: Deleting consensus metadata
I20260929 22:48:56.955749 28341 catalog_manager.cc:4841] TS 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): tablet 8ef0018ede964e45b380c1dffaaceb5e (table test-table [id=761bd72787784400af5f3f91a426147a]) successfully deleted
I20260929 22:48:56.956037 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.953478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52344 (local address 127.12.27.190:40913)
0929 22:48:56.953519 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.953521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.953604 (+ 83us) server_negotiation.cc:407] Connection header received
0929 22:48:56.953680 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.953681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.953703 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.953751 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:56.953878 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.954304 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.955264 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.955469 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.955522 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.955719 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:56.955829 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:56.955912 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.955949 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.955963 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:48:56.956331 28357 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:52344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:48:56.957862 28357 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:48:56.959817 28751 tablet_service.cc:1467] Processing CreateTablet for tablet 8bbad7f0db65444c9c3653edb23f2828 (DEFAULT_TABLE table=test-table [id=b54f0fefb6364219b1b75d7e6cad394a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:56.959985 28751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bbad7f0db65444c9c3653edb23f2828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:56.959964 28479 tablet_service.cc:1467] Processing CreateTablet for tablet 8bbad7f0db65444c9c3653edb23f2828 (DEFAULT_TABLE table=test-table [id=b54f0fefb6364219b1b75d7e6cad394a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:56.960109 28479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bbad7f0db65444c9c3653edb23f2828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:56.961417 28708 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Bootstrap starting.
I20260929 22:48:56.961591 28437 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Bootstrap starting.
I20260929 22:48:56.961829 28708 tablet_bootstrap.cc:654] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:56.961892 28437 tablet_bootstrap.cc:654] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:56.962363 28437 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: No bootstrap required, opened a new log
I20260929 22:48:56.962430 28437 ts_tablet_manager.cc:1397] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 22:48:56.962538 28437 raft_consensus.cc:348] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.962612 28437 raft_consensus.cc:374] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:56.962641 28708 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: No bootstrap required, opened a new log
I20260929 22:48:56.962663 28437 raft_consensus.cc:729] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608be70f239e400d9470641cdd5cd3fc, State: Initialized, Role: FOLLOWER
I20260929 22:48:56.962685 28708 ts_tablet_manager.cc:1397] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 22:48:56.962705 28437 consensus_queue.cc:260] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.962792 28437 ts_tablet_manager.cc:1428] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.962838 28708 raft_consensus.cc:348] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.962910 28708 raft_consensus.cc:374] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:56.962958 28708 raft_consensus.cc:729] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69883f1ccd6a42d99036dddfe6da909d, State: Initialized, Role: FOLLOWER
I20260929 22:48:56.963017 28708 consensus_queue.cc:260] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.963116 28708 ts_tablet_manager.cc:1428] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 22:48:56.963963 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.959587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37811 (local address 127.0.0.1:44744)
0929 22:48:56.959683 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:56.959692 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:56.959722 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:56.960041 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:56.960042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:56.960044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:56.960088 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.960089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.961117 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.961118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.962151 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:56.962154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.963722 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.963722 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:56.963806 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.963810 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:48:56.963873 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 22:48:56.963910 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260929 22:48:56.963979 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:56.959692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44744 (local address 127.12.27.130:37811)
0929 22:48:56.959868 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:56.959873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:56.959884 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:48:56.959944 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:56.959946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:56.959961 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:56.960045 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:56.960151 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.961038 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.962887 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:56.963617 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:56.963710 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:56.963773 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:56.963885 (+ 112us) server_negotiation.cc:299] Negotiation successful
0929 22:48:56.963919 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260929 22:48:56.964758 28617 tablet_service.cc:1467] Processing CreateTablet for tablet 8bbad7f0db65444c9c3653edb23f2828 (DEFAULT_TABLE table=test-table [id=b54f0fefb6364219b1b75d7e6cad394a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:48:56.965155 28617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bbad7f0db65444c9c3653edb23f2828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:48:56.967679 28829 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Bootstrap starting.
I20260929 22:48:56.968329 28829 tablet_bootstrap.cc:654] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Neither blocks nor log segments found. Creating new log.
I20260929 22:48:56.968820 28829 log.cc:824] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Log is configured to *not* fsync() on all Append() calls
I20260929 22:48:56.969470 28829 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: No bootstrap required, opened a new log
I20260929 22:48:56.969554 28829 ts_tablet_manager.cc:1397] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:48:56.970974 28829 raft_consensus.cc:348] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.971143 28829 raft_consensus.cc:374] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:48:56.971190 28829 raft_consensus.cc:729] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4910fb3a992f4df3916578f4109a9996, State: Initialized, Role: FOLLOWER
I20260929 22:48:56.971333 28829 consensus_queue.cc:260] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:56.971628 28829 ts_tablet_manager.cc:1428] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:48:56.971675 28683 heartbeater.cc:503] Master 127.12.27.190:40913 was elected leader, sending a full tablet report...
I20260929 22:48:57.019340 28551 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:48:57.019495 28551 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:57.019964 28551 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
W20260929 22:48:57.020637 28684 tablet.cc:2369] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:48:57.023399 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.020117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37811 (local address 127.12.27.129:33581)
0929 22:48:57.020183 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:57.020195 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:57.020239 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:57.020418 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:57.020419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:57.020420 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:57.020477 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:57.020479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.021252 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.021253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:57.022395 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:57.022398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.023127 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.023128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:57.023180 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.023183 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:48:57.023251 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 22:48:57.023280 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260929 22:48:57.023413 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.020195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:33581 (local address 127.12.27.130:37811)
0929 22:48:57.020243 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:57.020245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:57.020280 (+ 35us) server_negotiation.cc:407] Connection header received
0929 22:48:57.020310 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:57.020311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:57.020321 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:57.020382 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:57.020560 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.021173 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.022489 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.023050 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.023126 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.023134 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:57.023286 (+ 152us) server_negotiation.cc:299] Negotiation successful
0929 22:48:57.023338 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:48:57.023761 28637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbad7f0db65444c9c3653edb23f2828" candidate_uuid: "608be70f239e400d9470641cdd5cd3fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4910fb3a992f4df3916578f4109a9996" is_pre_election: true
I20260929 22:48:57.023916 28637 raft_consensus.cc:2454] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 608be70f239e400d9470641cdd5cd3fc in term 0.
I20260929 22:48:57.024158 28433 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4910fb3a992f4df3916578f4109a9996, 608be70f239e400d9470641cdd5cd3fc; no voters:
I20260929 22:48:57.024295 28551 raft_consensus.cc:2781] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:48:57.024338 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.020243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:52129 (local address 127.12.27.131:36131)
0929 22:48:57.020297 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:57.020299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:57.020419 (+ 120us) server_negotiation.cc:407] Connection header received
0929 22:48:57.020454 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:57.020455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:57.020479 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:57.020546 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:48:57.021059 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.022093 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.023372 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.024007 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.024080 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.024159 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:57.024207 (+ 48us) server_negotiation.cc:299] Negotiation successful
0929 22:48:57.024249 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:48:57.024369 28551 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:48:57.024408 28551 raft_consensus.cc:3037] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:57.024367 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.020143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36131 (local address 127.12.27.129:52129)
0929 22:48:57.020316 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:57.020327 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:48:57.020411 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:48:57.020572 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:48:57.020573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:48:57.020575 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:48:57.020974 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:57.020976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.022180 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.022181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:57.023283 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:48:57.023286 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.024077 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.024078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:48:57.024139 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.024142 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:48:57.024190 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 22:48:57.024225 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":96,"threads_started":1}
I20260929 22:48:57.024693 28771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbad7f0db65444c9c3653edb23f2828" candidate_uuid: "608be70f239e400d9470641cdd5cd3fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69883f1ccd6a42d99036dddfe6da909d" is_pre_election: true
I20260929 22:48:57.024837 28771 raft_consensus.cc:2454] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 608be70f239e400d9470641cdd5cd3fc in term 0.
I20260929 22:48:57.025213 28551 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:57.025367 28551 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 1 election: Requested vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
I20260929 22:48:57.025521 28637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbad7f0db65444c9c3653edb23f2828" candidate_uuid: "608be70f239e400d9470641cdd5cd3fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4910fb3a992f4df3916578f4109a9996"
I20260929 22:48:57.025602 28637 raft_consensus.cc:3037] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:57.026252 28637 raft_consensus.cc:2454] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 608be70f239e400d9470641cdd5cd3fc in term 1.
I20260929 22:48:57.026379 28771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbad7f0db65444c9c3653edb23f2828" candidate_uuid: "608be70f239e400d9470641cdd5cd3fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69883f1ccd6a42d99036dddfe6da909d"
I20260929 22:48:57.026451 28433 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4910fb3a992f4df3916578f4109a9996, 608be70f239e400d9470641cdd5cd3fc; no voters:
I20260929 22:48:57.026480 28771 raft_consensus.cc:3037] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:48:57.026525 28551 raft_consensus.cc:2781] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:48:57.026659 28551 raft_consensus.cc:686] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 LEADER]: Becoming Leader. State: Replica: 608be70f239e400d9470641cdd5cd3fc, State: Running, Role: LEADER
I20260929 22:48:57.026732 28551 consensus_queue.cc:237] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:48:57.027384 28771 raft_consensus.cc:2454] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 608be70f239e400d9470641cdd5cd3fc in term 1.
I20260929 22:48:57.027529 28356 catalog_manager.cc:5495] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 608be70f239e400d9470641cdd5cd3fc (127.12.27.129). New cstate: current_term: 1 leader_uuid: "608be70f239e400d9470641cdd5cd3fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } health_report { overall_health: UNKNOWN } } }
I20260929 22:48:57.035609 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.033725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48190 (local address 127.12.27.129:41817)
0929 22:48:57.033779 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:57.033781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:57.033790 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:57.033844 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:57.033844 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:57.033859 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:57.033919 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:57.034023 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.034460 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.035100 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.035266 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.035312 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.035432 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:57.035470 (+ 38us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0929 22:48:57.035570 (+ 100us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48190: token expired
Metrics: {"server-negotiator.queue_time_us":33}
W20260929 22:48:57.035701 28553 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48190: token expired
I20260929 22:48:57.041297 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.035991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52348 (local address 127.12.27.190:40913)
0929 22:48:57.036030 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:57.036032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:57.036062 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:48:57.036107 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:57.036108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:57.036116 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:57.036156 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:48:57.036597 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.037032 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.037649 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.037817 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.037875 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.039010 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:48:57.039012 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:48:57.039012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:48:57.039017 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:48:57.040353 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:57.040664 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:57.040665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:57.040665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:57.040713 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:48:57.040880 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:48:57.040880 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:48:57.040880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:48:57.040967 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:48:57.041036 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:57.041181 (+ 145us) server_negotiation.cc:299] Negotiation successful
0929 22:48:57.041239 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:48:57.044446 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.042353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.12.27.129:41817)
0929 22:48:57.042405 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:48:57.042407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:48:57.042416 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:48:57.042437 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:48:57.042438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:48:57.042448 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:48:57.042518 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:48:57.042602 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.043032 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.043733 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:48:57.043914 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:48:57.043984 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:48:57.044134 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:48:57.044219 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:48:57.044284 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:48:57.044347 (+ 63us) server_negotiation.cc:299] Negotiation successful
0929 22:48:57.044372 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:48:57.045971 28771 raft_consensus.cc:1261] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Refusing update from remote peer 608be70f239e400d9470641cdd5cd3fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:57.046088 28637 raft_consensus.cc:1261] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Refusing update from remote peer 608be70f239e400d9470641cdd5cd3fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:48:57.046288 28551 consensus_queue.cc:1035] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:57.046442 28833 consensus_queue.cc:1035] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:48:57.049335 28838 mvcc.cc:205] Tried to move back new op lower bound from 7334797873337593856 to 7334797873262018560. Current Snapshot: MvccSnapshot[applied={T|T < 7334797873337593856}]
I20260929 22:48:57.050771 28357 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:57.050843 28357 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:48:57.051556 28357 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Sending DeleteTablet for 3 replicas of tablet 8bbad7f0db65444c9c3653edb23f2828
I20260929 22:48:57.051877 28751 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bbad7f0db65444c9c3653edb23f2828 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:57 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:50772
I20260929 22:48:57.051903 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28395
I20260929 22:48:57.051926 28617 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bbad7f0db65444c9c3653edb23f2828 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:48:57 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:44744
I20260929 22:48:57.051962 28824 tablet_replica.cc:330] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: stopping tablet replica
I20260929 22:48:57.052003 28824 raft_consensus.cc:2229] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:57.052034 28824 raft_consensus.cc:2258] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:57.052611 28845 tablet_replica.cc:330] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: stopping tablet replica
I20260929 22:48:57.052698 28845 raft_consensus.cc:2229] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:48:57.052795 28845 raft_consensus.cc:2258] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:48:57.053520 28845 ts_tablet_manager.cc:1905] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:57.053783 28824 ts_tablet_manager.cc:1905] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:48:57.055270 28845 ts_tablet_manager.cc:1918] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:57.055377 28845 log.cc:1196] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/8bbad7f0db65444c9c3653edb23f2828
I20260929 22:48:57.055702 28845 ts_tablet_manager.cc:1939] T 8bbad7f0db65444c9c3653edb23f2828 P 4910fb3a992f4df3916578f4109a9996: Deleting consensus metadata
I20260929 22:48:57.055738 28824 ts_tablet_manager.cc:1918] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:48:57.055796 28824 log.cc:1196] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/8bbad7f0db65444c9c3653edb23f2828
I20260929 22:48:57.056013 28824 ts_tablet_manager.cc:1939] T 8bbad7f0db65444c9c3653edb23f2828 P 69883f1ccd6a42d99036dddfe6da909d: Deleting consensus metadata
I20260929 22:48:57.056113 28343 catalog_manager.cc:4841] TS 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): tablet 8bbad7f0db65444c9c3653edb23f2828 (table test-table [id=b54f0fefb6364219b1b75d7e6cad394a]) successfully deleted
I20260929 22:48:57.056284 28341 catalog_manager.cc:4841] TS 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): tablet 8bbad7f0db65444c9c3653edb23f2828 (table test-table [id=b54f0fefb6364219b1b75d7e6cad394a]) successfully deleted
W20260929 22:48:57.058154 28343 connection.cc:535] client connection to 127.12.27.129:41817 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 22:48:57.058233 28343 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:48:57.058490 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28549
I20260929 22:48:57.059099 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:48:57.058609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:41817 (local address 127.0.0.1:48202)
0929 22:48:57.059020 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0929 22:48:57.059061 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:41817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393}
W20260929 22:48:57.060220 28343 catalog_manager.cc:4584] TS 608be70f239e400d9470641cdd5cd3fc (127.12.27.129:41817): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8bbad7f0db65444c9c3653edb23f2828: Network error: Client connection negotiation failed: client connection to 127.12.27.129:41817: connect: Connection refused (error 111)
I20260929 22:48:57.063421 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28686
I20260929 22:48:57.067924 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28324
I20260929 22:49:17.073220 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40913
--webserver_interface=127.12.27.190
--webserver_port=38483
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:40913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:17.153529 28847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:17.153770 28847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:17.153818 28847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:17.155000 28847 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 22:49:17.155072 28847 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 22:49:17.155093 28847 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 22:49:17.155112 28847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:17.155140 28847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:17.155172 28847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:17.155194 28847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:17.155216 28847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:17.156750 28847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:40913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=38483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:17.157042 28847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:17.157276 28847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:17.162186 28852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:17.162212 28853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:17.162300 28855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:17.162357 28847 server_base.cc:1034] running on GCE node
I20260929 22:49:17.162665 28847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:17.162961 28847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:17.164124 28847 hybrid_clock.cc:648] HybridClock initialized: now 1790722157164111 us; error 26 us; skew 500 ppm
Sep 29 22:49:17 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:17.166514 28847 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:49:17.166998 28847 webserver.cc:460] Webserver started at http://127.12.27.190:38483/ using document root <none> and password file <none>
I20260929 22:49:17.167243 28847 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:17.167315 28847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:17.168684 28847 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:17.169353 28862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.169530 28847 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:17.169634 28847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "4f9238435797427481f1e532b9069759"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "9ad5d730166593de76a66da74c435beb"
server_key_iv: "cc1eead2d9f794147d5e2e6940a3d33a"
server_key_version: "encryptionkey@0"
I20260929 22:49:17.169994 28847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:17.182500 28847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:17.184641 28847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:17.184826 28847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:17.189144 28847 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:40913
I20260929 22:49:17.189515 28914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:40913 every 8 connection(s)
I20260929 22:49:17.189556 28847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:17.190733 28915 sys_catalog.cc:263] Verifying existing consensus state
I20260929 22:49:17.191306 28915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap starting.
I20260929 22:49:17.198392 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28847
I20260929 22:49:17.198681 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:41817
--local_ip_for_outbound_sockets=127.12.27.129
--tserver_master_addrs=127.12.27.190:40913
--webserver_port=42053
--webserver_interface=127.12.27.129
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:49:17.199586 28915 log.cc:824] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:17.202351 28915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:49:17.202656 28915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Bootstrap complete.
I20260929 22:49:17.205099 28915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:49:17.205315 28915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f9238435797427481f1e532b9069759, State: Initialized, Role: FOLLOWER
I20260929 22:49:17.205489 28915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:49:17.205575 28915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:17.205650 28915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:17.205695 28915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 2 FOLLOWER]: Advancing to term 3
I20260929 22:49:17.206687 28915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:49:17.206781 28915 leader_election.cc:302] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f9238435797427481f1e532b9069759; no voters:
I20260929 22:49:17.206979 28915 leader_election.cc:288] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 22:49:17.207015 28919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 22:49:17.207139 28919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [term 3 LEADER]: Becoming Leader. State: Replica: 4f9238435797427481f1e532b9069759, State: Running, Role: LEADER
I20260929 22:49:17.207254 28915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:17.207297 28919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } }
I20260929 22:49:17.207623 28920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4f9238435797427481f1e532b9069759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } } }
I20260929 22:49:17.207710 28920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:17.207998 28921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f9238435797427481f1e532b9069759. Latest consensus state: current_term: 3 leader_uuid: "4f9238435797427481f1e532b9069759" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f9238435797427481f1e532b9069759" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40913 } } }
I20260929 22:49:17.208061 28921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:17.208209 28924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:17.209072 28924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:17.209239 28924 catalog_manager.cc:1259] Loaded cluster ID: 2560f0bd5c9c45b391ce7effffc78623
I20260929 22:49:17.209434 28924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:17.210229 28924 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:17.210435 28924 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Loaded TSK: 0
I20260929 22:49:17.210496 28924 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4f9238435797427481f1e532b9069759: Loaded TSK: 1
F20260929 22:49:17.210732 28924 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe7e54b59ad google::LogMessage::Fail() at ??:0
@ 0x7fe7e54b888a google::LogMessage::SendToLog() at ??:0
@ 0x7fe7e54b54de google::LogMessage::Flush() at ??:0
@ 0x7fe7e54b6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe7e7c22104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe7e7c1fd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe7ed40f1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe7ed40f48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe7ed40f594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fe7ed3d5c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fe7ed3dfad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe7e73830d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe7e7378954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe7e81dc6db start_thread at ??:0
@ 0x7fe7e3fb361f clone at ??:0
W20260929 22:49:17.297201 28917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:17.297453 28917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:17.297490 28917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:17.298635 28917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:17.298704 28917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:17.298750 28917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:17.300304 28917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:41817
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=42053
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:17.300576 28917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:17.300812 28917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:17.305824 28957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:17.305835 28960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:17.305914 28958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:17.306290 28917 server_base.cc:1034] running on GCE node
I20260929 22:49:17.306492 28917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:17.306769 28917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:17.307931 28917 hybrid_clock.cc:648] HybridClock initialized: now 1790722157307911 us; error 34 us; skew 500 ppm
Sep 29 22:49:17 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:17.310515 28917 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:49:17.310979 28917 webserver.cc:460] Webserver started at http://127.12.27.129:42053/ using document root <none> and password file <none>
I20260929 22:49:17.311221 28917 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:17.311299 28917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:17.312747 28917 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:17.313478 28967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.313678 28917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:17.313745 28917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "608be70f239e400d9470641cdd5cd3fc"
format_stamp: "Formatted at 2026-09-29 22:48:35 on dist-test-slave-00d6"
server_key: "0893eda8eede8fb8dcb3f0b2e2b50f12"
server_key_iv: "54a29190f1c6b6c05e8fe9ff3ef8863b"
server_key_version: "encryptionkey@0"
I20260929 22:49:17.314129 28917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:17.327323 28917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:17.329725 28917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:17.329867 28917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:17.330121 28917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:17.330552 28974 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 22:49:17.332614 28917 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 22:49:17.332712 28917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 22:49:17.332765 28917 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 22:49:17.333436 28917 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 22:49:17.333501 28917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 22:49:17.333575 28974 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Bootstrap starting.
I20260929 22:49:17.341228 28917 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:41817
I20260929 22:49:17.341295 29081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:41817 every 8 connection(s)
I20260929 22:49:17.341713 28917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:49:17.344143 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 28917
I20260929 22:49:17.344453 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:37811
--local_ip_for_outbound_sockets=127.12.27.130
--tserver_master_addrs=127.12.27.190:40913
--webserver_port=40263
--webserver_interface=127.12.27.130
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:49:17.344592 28974 log.cc:824] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:17.347497 28974 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 22:49:17.347867 28974 tablet_bootstrap.cc:492] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Bootstrap complete.
I20260929 22:49:17.349126 28974 ts_tablet_manager.cc:1397] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260929 22:49:17.350543 28974 raft_consensus.cc:348] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:17.350881 28974 raft_consensus.cc:729] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608be70f239e400d9470641cdd5cd3fc, State: Initialized, Role: FOLLOWER
I20260929 22:49:17.351042 28974 consensus_queue.cc:260] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:17.351307 28974 ts_tablet_manager.cc:1428] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260929 22:49:17.410633 29084 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:49:17.342463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:35543)
0929 22:49:17.342661 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.342707 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:17.343168 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:17.410387 (+ 67219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":109,"threads_started":1}
W20260929 22:49:17.410944 29082 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:40913 (0 consecutive failures): Network error: Failed to ping master at 127.12.27.190:40913: Client connection negotiation failed: client connection to 127.12.27.190:40913: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 22:49:17.411321 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.411191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:47157)
0929 22:49:17.411248 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.411292 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 22:49:17.411746 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.411671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:44561)
0929 22:49:17.411704 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.411728 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260929 22:49:17.411934 29082 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:49:17.429464 29086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:17.429669 29086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:17.429693 29086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:17.430860 29086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:17.430907 29086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:17.430966 29086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:17.432607 29086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:37811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=40263
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:17.432860 29086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:17.433111 29086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:17.438382 29093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:17.438468 29086 server_base.cc:1034] running on GCE node
W20260929 22:49:17.438378 29095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:17.438378 29092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:17.438776 29086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:17.439044 29086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:17.440219 29086 hybrid_clock.cc:648] HybridClock initialized: now 1790722157440192 us; error 57 us; skew 500 ppm
Sep 29 22:49:17 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:17.447002 29086 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:49:17.447474 29086 webserver.cc:460] Webserver started at http://127.12.27.130:40263/ using document root <none> and password file <none>
I20260929 22:49:17.447765 29086 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:17.447855 29086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:17.449229 29086 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:17.449855 29102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.450035 29086 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:17.450140 29086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "4910fb3a992f4df3916578f4109a9996"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "cd9b06234a4c2f67acf22d6491117729"
server_key_iv: "cf5a4dcd4fd826758a9bb0c6a19ab7fe"
server_key_version: "encryptionkey@0"
I20260929 22:49:17.450572 29086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:17.459787 29086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:17.461946 29086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:17.462118 29086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:17.462348 29086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:17.462659 29086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:17.462718 29086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.462759 29086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:17.462785 29086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.468714 29086 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:37811
I20260929 22:49:17.468760 29215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:37811 every 8 connection(s)
I20260929 22:49:17.469106 29086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:49:17.470194 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.469748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:55225)
0929 22:49:17.469921 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.470034 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
W20260929 22:49:17.470647 29216 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:40913 (0 consecutive failures): Network error: Failed to ping master at 127.12.27.190:40913: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
I20260929 22:49:17.470752 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29086
I20260929 22:49:17.470954 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.470849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:59931)
0929 22:49:17.470903 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.470928 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:49:17.471091 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:36131
--local_ip_for_outbound_sockets=127.12.27.131
--tserver_master_addrs=127.12.27.190:40913
--webserver_port=34349
--webserver_interface=127.12.27.131
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:49:17.471314 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.471145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:37429)
0929 22:49:17.471255 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.471281 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260929 22:49:17.471433 29216 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 22:49:17.552790 29219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:17.553042 29219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:17.553112 29219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:17.554409 29219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:17.554452 29219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:17.554479 29219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:17.555956 29219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:36131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=34349
--tserver_master_addrs=127.12.27.190:40913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:17.556144 29219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:17.556329 29219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:17.561357 29227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:17.561371 29225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:17.561549 29219 server_base.cc:1034] running on GCE node
W20260929 22:49:17.561357 29224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:17.561858 29219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:17.562110 29219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:17.563287 29219 hybrid_clock.cc:648] HybridClock initialized: now 1790722157563270 us; error 54 us; skew 500 ppm
Sep 29 22:49:17 dist-test-slave-00d6 krb5kdc[27780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:17.565961 29219 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:49:17.566354 29219 webserver.cc:460] Webserver started at http://127.12.27.131:34349/ using document root <none> and password file <none>
I20260929 22:49:17.566584 29219 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:17.566629 29219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:17.568090 29219 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:17.568712 29234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.568879 29219 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:17.568990 29219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "69883f1ccd6a42d99036dddfe6da909d"
format_stamp: "Formatted at 2026-09-29 22:48:36 on dist-test-slave-00d6"
server_key: "795fde2d12b2679efa9b20f375ee85e9"
server_key_iv: "2dcbcb64fb092fe2b2030e28009737d9"
server_key_version: "encryptionkey@0"
I20260929 22:49:17.569370 29219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:17.578866 29219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:17.581380 29219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:17.581549 29219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:17.581804 29219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:17.582113 29219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:17.582168 29219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.582212 29219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:17.582238 29219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:17.588176 29219 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:36131
I20260929 22:49:17.588256 29347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:36131 every 8 connection(s)
I20260929 22:49:17.588661 29219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:49:17.589733 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.589357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:37011)
0929 22:49:17.589514 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.589585 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
W20260929 22:49:17.590188 29348 heartbeater.cc:644] Failed to heartbeat to 127.12.27.190:40913 (0 consecutive failures): Network error: Failed to ping master at 127.12.27.190:40913: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
I20260929 22:49:17.590477 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.590388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:51337)
0929 22:49:17.590434 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.590460 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:49:17.590801 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:17.590690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:39685)
0929 22:49:17.590739 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:17.590762 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260929 22:49:17.590909 29348 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 22:49:17.596151 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29219
I20260929 22:49:18.412509 29352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:18.412290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:35425)
0929 22:49:18.412413 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:18.412449 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260929 22:49:18.471979 29353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:18.471757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:39003)
0929 22:49:18.471882 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:18.471915 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260929 22:49:18.591467 29354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:18.591217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:39021)
0929 22:49:18.591373 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:18.591412 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260929 22:49:19.181021 29355 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:19.181145 29355 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:19.181521 29355 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
Sep 29 22:49:19 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.131@KRBTEST.COM
Sep 29 22:49:19 dist-test-slave-00d6 krb5kdc[27780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.130@KRBTEST.COM
I20260929 22:49:19.192448 29359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.181901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:51529 (local address 127.12.27.130:37811)
0929 22:49:19.182072 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:19.182087 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:19.182105 (+ 18us) server_negotiation.cc:407] Connection header received
0929 22:49:19.182587 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:19.182589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:19.182636 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:19.182799 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:19.183520 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.184448 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.185423 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.185818 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.185955 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:19.188917 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:19.188922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:19.188922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:19.188933 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:19.190825 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:19.191238 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:19.191241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:19.191241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:19.191340 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:19.191572 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:19.191573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:19.191573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:19.191909 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:19.191990 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:19.192196 (+ 206us) server_negotiation.cc:299] Negotiation successful
0929 22:49:19.192335 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":74,"threads_started":1}
I20260929 22:49:19.192457 29357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.181751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36131 (local address 127.12.27.129:53625)
0929 22:49:19.182063 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:19.182075 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:19.182149 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:19.182828 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:19.182830 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:19.183201 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:19.183397 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:19.183403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.184547 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.184548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:19.185319 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:19.185321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.185932 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.185933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:19.186046 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:19.186713 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:19.186718 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:19.188412 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:19.190581 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:19.190588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:19.190590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:19.190890 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:19.191158 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:19.191159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:19.191159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:19.191341 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:19.191861 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:19.191867 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:19.192012 (+ 145us) client_negotiation.cc:769] Sending connection context
0929 22:49:19.192162 (+ 150us) client_negotiation.cc:240] Negotiation successful
0929 22:49:19.192362 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":111,"thread_start_us":72,"threads_started":1}
I20260929 22:49:19.192510 29358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.181899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:53625 (local address 127.12.27.131:36131)
0929 22:49:19.182059 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:19.182074 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:19.182138 (+ 64us) server_negotiation.cc:407] Connection header received
0929 22:49:19.182612 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:19.182614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:19.182651 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:19.182838 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:19.183527 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.184422 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.185428 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.185831 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.185955 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:19.188537 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:19.188541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:19.188541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:19.188551 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:19.190494 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:19.190972 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:19.190975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:19.190975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:19.191083 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:19.191424 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:19.191425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:19.191425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:19.191788 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:19.191855 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:19.192242 (+ 387us) server_negotiation.cc:299] Negotiation successful
0929 22:49:19.192395 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":50,"threads_started":1}
I20260929 22:49:19.192569 29356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.181750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37811 (local address 127.12.27.129:51529)
0929 22:49:19.181916 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:19.181926 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:19.181997 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:19.182826 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:19.182829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:19.183201 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:19.183397 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:19.183403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.184566 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.184567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:19.185318 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:19.185319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:19.185931 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:19.185932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:19.186047 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:19.186665 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:19.186673 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:19.188807 (+ 2134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:19.190911 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:19.190912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:19.190912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:19.191159 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:19.191424 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:19.191425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:19.191425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:19.191507 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:19.191981 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:19.191982 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:19.192018 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 22:49:19.192124 (+ 106us) client_negotiation.cc:240] Negotiation successful
0929 22:49:19.192449 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":145,"thread_start_us":81,"threads_started":1}
W20260929 22:49:19.193296 28968 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
W20260929 22:49:19.193734 28970 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
I20260929 22:49:19.193800 28970 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 608be70f239e400d9470641cdd5cd3fc; no voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d
I20260929 22:49:19.193951 29355 raft_consensus.cc:2726] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:49:19.413141 29357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.413012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:35621)
0929 22:49:19.413068 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:19.413100 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:49:19.472656 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.472424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:37103)
0929 22:49:19.472560 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:19.472608 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260929 22:49:19.592088 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:19.591864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:52987)
0929 22:49:19.591999 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:19.592044 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
I20260929 22:49:20.413877 29362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:20.413637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:46231)
0929 22:49:20.413777 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:20.413812 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260929 22:49:20.473299 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:20.473074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:40775)
0929 22:49:20.473223 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:20.473258 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260929 22:49:20.592775 29364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:20.592554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:47247)
0929 22:49:20.592694 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:20.592733 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":56,"threads_started":1}
I20260929 22:49:20.878273 29365 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:20.878379 29365 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:20.878592 29365 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
W20260929 22:49:20.879092 28968 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
W20260929 22:49:20.879266 28970 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
I20260929 22:49:20.879320 28970 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 608be70f239e400d9470641cdd5cd3fc; no voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d
I20260929 22:49:20.879403 29365 raft_consensus.cc:2726] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:49:21.414750 29366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:21.414474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:56007)
0929 22:49:21.414656 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:21.414700 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":80,"threads_started":1}
I20260929 22:49:21.473923 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:21.473728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:55059)
0929 22:49:21.473851 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:21.473885 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260929 22:49:21.593490 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:21.593270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:53247)
0929 22:49:21.593405 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:21.593448 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":58,"threads_started":1}
I20260929 22:49:22.415522 29369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:22.415272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:50633)
0929 22:49:22.415439 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:22.415474 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260929 22:49:22.474645 29370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:22.474402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:33649)
0929 22:49:22.474535 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:22.474585 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260929 22:49:22.502882 29371 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:22.502982 29371 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:22.503165 29371 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
W20260929 22:49:22.503557 28970 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
W20260929 22:49:22.503683 28968 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
I20260929 22:49:22.503772 28968 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 608be70f239e400d9470641cdd5cd3fc; no voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d
I20260929 22:49:22.503876 29371 raft_consensus.cc:2726] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:49:22.594151 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:22.593929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:50089)
0929 22:49:22.594069 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:22.594105 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260929 22:49:23.416224 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:23.415984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:46347)
0929 22:49:23.416126 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:23.416168 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":60,"threads_started":1}
I20260929 22:49:23.475265 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:23.475074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:34921)
0929 22:49:23.475194 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:23.475226 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260929 22:49:23.594830 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:23.594596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:46047)
0929 22:49:23.594728 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:23.594766 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260929 22:49:24.078155 29376 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:24.078298 29376 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:24.078498 29376 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
W20260929 22:49:24.078909 28970 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
W20260929 22:49:24.078989 28968 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
I20260929 22:49:24.079082 28968 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 608be70f239e400d9470641cdd5cd3fc; no voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d
I20260929 22:49:24.079174 29376 raft_consensus.cc:2726] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:49:24.416952 29377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:24.416718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:52293)
0929 22:49:24.416864 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:24.416905 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
I20260929 22:49:24.475953 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:24.475727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:49613)
0929 22:49:24.475870 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:24.475910 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260929 22:49:24.595486 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:24.595278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:57709)
0929 22:49:24.595403 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:24.595441 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260929 22:49:25.417636 29380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:25.417423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:48573)
0929 22:49:25.417559 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:25.417592 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260929 22:49:25.476678 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:25.476488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:42929)
0929 22:49:25.476603 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:25.476637 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260929 22:49:25.596099 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:25.595920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:40863)
0929 22:49:25.596028 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:25.596059 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260929 22:49:26.418192 29383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:26.417978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:33931)
0929 22:49:26.418108 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:26.418145 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260929 22:49:26.477313 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:26.477094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:53301)
0929 22:49:26.477223 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:26.477270 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260929 22:49:26.596745 29385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:26.596532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:45323)
0929 22:49:26.596661 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:26.596697 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
I20260929 22:49:27.418816 29386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:27.418601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:50749)
0929 22:49:27.418733 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:27.418771 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260929 22:49:27.477952 29387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:27.477742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:52303)
0929 22:49:27.477870 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:27.477906 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260929 22:49:27.597457 29388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:27.597172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:36473)
0929 22:49:27.597339 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:27.597385 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
I20260929 22:49:28.419498 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:28.419284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:58021)
0929 22:49:28.419416 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:28.419452 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
I20260929 22:49:28.478631 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:28.478413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:60527)
0929 22:49:28.478548 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:28.478587 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260929 22:49:28.598129 29391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:28.597925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:45965)
0929 22:49:28.598052 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:28.598086 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260929 22:49:29.420218 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:29.419991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:51313)
0929 22:49:29.420132 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:29.420170 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260929 22:49:29.479336 29393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:29.479113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:33973)
0929 22:49:29.479244 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:29.479290 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260929 22:49:29.598884 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:29.598632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:52293)
0929 22:49:29.598800 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:29.598840 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":75,"threads_started":1}
I20260929 22:49:30.420884 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:30.420661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:40867)
0929 22:49:30.420803 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:30.420838 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260929 22:49:30.480118 29396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:30.479910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:60221)
0929 22:49:30.480030 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:30.480072 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260929 22:49:30.580088 29397 raft_consensus.cc:482] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:30.580210 29397 raft_consensus.cc:504] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4910fb3a992f4df3916578f4109a9996" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37811 } } peers { permanent_uuid: "608be70f239e400d9470641cdd5cd3fc" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 41817 } } peers { permanent_uuid: "69883f1ccd6a42d99036dddfe6da909d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36131 } }
I20260929 22:49:30.580418 29397 leader_election.cc:288] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811), 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131)
W20260929 22:49:30.580816 28970 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4910fb3a992f4df3916578f4109a9996 (127.12.27.130:37811): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
W20260929 22:49:30.580884 28968 leader_election.cc:341] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69883f1ccd6a42d99036dddfe6da909d (127.12.27.131:36131): Not found: Tablet not found: 8bbad7f0db65444c9c3653edb23f2828
I20260929 22:49:30.580960 28968 leader_election.cc:302] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 608be70f239e400d9470641cdd5cd3fc; no voters: 4910fb3a992f4df3916578f4109a9996, 69883f1ccd6a42d99036dddfe6da909d
I20260929 22:49:30.581064 29397 raft_consensus.cc:2726] T 8bbad7f0db65444c9c3653edb23f2828 P 608be70f239e400d9470641cdd5cd3fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 22:49:30.599555 29398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:30.599342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:49403)
0929 22:49:30.599471 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:30.599510 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
I20260929 22:49:31.421514 29399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:31.421314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:40673)
0929 22:49:31.421429 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:31.421466 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260929 22:49:31.480763 29400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:31.480578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:49043)
0929 22:49:31.480688 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:31.480720 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260929 22:49:31.600242 29401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:31.600014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:42795)
0929 22:49:31.600146 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:31.600183 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":60,"threads_started":1}
I20260929 22:49:32.422253 29402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:32.422038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.129:38021)
0929 22:49:32.422169 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:32.422203 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260929 22:49:32.481537 29403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:32.481284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.130:33427)
0929 22:49:32.481434 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:32.481480 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":59,"threads_started":1}
I20260929 22:49:32.601017 29404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:32.600792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:40913 (local address 127.12.27.131:34377)
0929 22:49:32.600937 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:32.600973 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.190:40913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260929 22:49:32.603058 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 28917
I20260929 22:49:32.607858 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29086
I20260929 22:49:32.611847 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29219
2026-09-29T22:49:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58199 ms)
[----------] 30 tests from SecurityITest (256933 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:32 dist-test-slave-00d6 krb5kdc[29407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:32 dist-test-slave-00d6 krb5kdc[29407](info): set up 2 sockets
Sep 29 22:49:32 dist-test-slave-00d6 krb5kdc[29407](info): commencing operation
krb5kdc: starting...
W20260929 22:49:33.643817 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:33 dist-test-slave-00d6 krb5kdc[29407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:49:33.760398 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45605
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:45605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:33.841493 29420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:33.841738 29420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:33.841760 29420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:33.842856 29420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:33.842893 29420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:33.842908 29420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:33.842921 29420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:33.842932 29420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:33.844363 29420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:45605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:45605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:33.844627 29420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:33.844815 29420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:49:33.849934 29420 server_base.cc:1034] running on GCE node
W20260929 22:49:33.849905 29425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:33.849920 29428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:33.849944 29426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:33.850374 29420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:33.850644 29420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:33.851778 29420 hybrid_clock.cc:648] HybridClock initialized: now 1790722173851754 us; error 38 us; skew 500 ppm
Sep 29 22:49:33 dist-test-slave-00d6 krb5kdc[29407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:33.854344 29420 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:49:33.854817 29420 webserver.cc:460] Webserver started at http://127.12.27.190:33753/ using document root <none> and password file <none>
I20260929 22:49:33.855042 29420 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:33.855109 29420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:33.855263 29420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:33.856520 29420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "11fbe0911a714b58a8998696d6bc3f01"
format_stamp: "Formatted at 2026-09-29 22:49:33 on dist-test-slave-00d6"
server_key: "1687070a887032d2be2cc27688601430"
server_key_iv: "37f8e16500ea9464ee8b0a8d1b3e13a2"
server_key_version: "encryptionkey@0"
I20260929 22:49:33.856890 29420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "11fbe0911a714b58a8998696d6bc3f01"
format_stamp: "Formatted at 2026-09-29 22:49:33 on dist-test-slave-00d6"
server_key: "1687070a887032d2be2cc27688601430"
server_key_iv: "37f8e16500ea9464ee8b0a8d1b3e13a2"
server_key_version: "encryptionkey@0"
I20260929 22:49:33.858168 29420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:49:33.858920 29435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:33.859084 29420 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:49:33.859189 29420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "11fbe0911a714b58a8998696d6bc3f01"
format_stamp: "Formatted at 2026-09-29 22:49:33 on dist-test-slave-00d6"
server_key: "1687070a887032d2be2cc27688601430"
server_key_iv: "37f8e16500ea9464ee8b0a8d1b3e13a2"
server_key_version: "encryptionkey@0"
I20260929 22:49:33.859272 29420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:33.871923 29420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:33.874280 29420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:33.874441 29420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:33.878407 29420 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:45605
I20260929 22:49:33.878432 29487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:45605 every 8 connection(s)
I20260929 22:49:33.878769 29420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:33.879582 29488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:33.881798 29488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01: Bootstrap starting.
I20260929 22:49:33.882367 29488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:33.882650 29488 log.cc:824] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:33.883354 29488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01: No bootstrap required, opened a new log
I20260929 22:49:33.884956 29488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fbe0911a714b58a8998696d6bc3f01" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45605 } }
I20260929 22:49:33.885118 29488 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:33.885113 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29420
I20260929 22:49:33.885169 29488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11fbe0911a714b58a8998696d6bc3f01, State: Initialized, Role: FOLLOWER
I20260929 22:49:33.885216 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:33.885329 29488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fbe0911a714b58a8998696d6bc3f01" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45605 } }
I20260929 22:49:33.885409 29488 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:33.885453 29488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:33.885465 12398 external_mini_cluster.cc:1428] Setting key 3cad2d20a25a18f89406e85ca24a3e1a
I20260929 22:49:33.885502 29488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:33.886195 29488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fbe0911a714b58a8998696d6bc3f01" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45605 } }
I20260929 22:49:33.886317 29488 leader_election.cc:302] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11fbe0911a714b58a8998696d6bc3f01; no voters:
I20260929 22:49:33.886479 29488 leader_election.cc:288] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:33.886516 29493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:33.886621 29493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [term 1 LEADER]: Becoming Leader. State: Replica: 11fbe0911a714b58a8998696d6bc3f01, State: Running, Role: LEADER
I20260929 22:49:33.886729 29488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:33.886766 29493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fbe0911a714b58a8998696d6bc3f01" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45605 } }
I20260929 22:49:33.887159 29494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11fbe0911a714b58a8998696d6bc3f01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fbe0911a714b58a8998696d6bc3f01" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45605 } } }
I20260929 22:49:33.887248 29494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:33.887511 29495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11fbe0911a714b58a8998696d6bc3f01. Latest consensus state: current_term: 1 leader_uuid: "11fbe0911a714b58a8998696d6bc3f01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11fbe0911a714b58a8998696d6bc3f01" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 45605 } } }
I20260929 22:49:33.887650 29495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:33.887957 29500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:33.888427 29500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:33.890209 29500 catalog_manager.cc:1347] Generated new cluster ID: aed69d7692e349c1ae4d11a72523ef19
I20260929 22:49:33.890260 29500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:49:33 dist-test-slave-00d6 krb5kdc[29407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:33.897298 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:33.886201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.12.27.190:45605)
0929 22:49:33.886371 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:33.886379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:33.886429 (+ 50us) server_negotiation.cc:407] Connection header received
0929 22:49:33.886550 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:33.886557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:33.886615 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:33.887528 (+ 913us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:33.887719 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:33.889097 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:33.890158 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:33.890771 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:33.890866 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:33.893532 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:33.893536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:33.893536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:33.893547 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:33.895482 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:33.895859 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:33.895862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:33.895863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:33.895966 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:33.896128 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:33.896128 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:33.896128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:33.896398 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:33.896527 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:33.896942 (+ 415us) server_negotiation.cc:299] Negotiation successful
0929 22:49:33.897061 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":90,"threads_started":1}
I20260929 22:49:33.901338 29500 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:33.902030 29500 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:33.913694 29500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01: Generated new TSK 0
I20260929 22:49:33.913878 29500 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:49:33.943370 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45605
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:34.025228 29514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:34.025444 29514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:34.025467 29514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:34.026638 29514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:34.026687 29514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:34.026715 29514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:34.028303 29514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:34.028553 29514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:34.028788 29514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:34.033972 29519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.034016 29522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.033979 29520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.034215 29514 server_base.cc:1034] running on GCE node
I20260929 22:49:34.034416 29514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:34.034637 29514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:34.035817 29514 hybrid_clock.cc:648] HybridClock initialized: now 1790722174035804 us; error 32 us; skew 500 ppm
Sep 29 22:49:34 dist-test-slave-00d6 krb5kdc[29407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:34.038455 29514 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:49:34.038897 29514 webserver.cc:460] Webserver started at http://127.12.27.129:41179/ using document root <none> and password file <none>
I20260929 22:49:34.039157 29514 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:34.039211 29514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:34.039369 29514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:34.040516 29514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "be5dd50cd8fe47d5aa6794872a1268c3"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "16ddbe0311e96a1fea71a169dbaa6b96"
server_key_iv: "0635323251abbcebccfdaed99653d4c4"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.040848 29514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "be5dd50cd8fe47d5aa6794872a1268c3"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "16ddbe0311e96a1fea71a169dbaa6b96"
server_key_iv: "0635323251abbcebccfdaed99653d4c4"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.042204 29514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:49:34.042953 29529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.043159 29514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:34.043270 29514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "be5dd50cd8fe47d5aa6794872a1268c3"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "16ddbe0311e96a1fea71a169dbaa6b96"
server_key_iv: "0635323251abbcebccfdaed99653d4c4"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.043360 29514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:34.063108 29514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:34.065217 29514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:34.065394 29514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:34.065634 29514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:34.065972 29514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:34.066033 29514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.066075 29514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:34.066103 29514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.071868 29514 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:44367
I20260929 22:49:34.071946 29642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:44367 every 8 connection(s)
I20260929 22:49:34.072322 29514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:49:34 dist-test-slave-00d6 krb5kdc[29407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:34.078424 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29514
I20260929 22:49:34.078547 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:49:34.078778 12398 external_mini_cluster.cc:1428] Setting key 3cf794293bc34035c05b8b43f18041bc
I20260929 22:49:34.081545 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.073167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:59731 (local address 127.12.27.190:45605)
0929 22:49:34.073220 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.073222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.073343 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:49:34.073806 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.073806 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.073816 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.073879 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.074773 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.075262 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.076289 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.076472 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.076523 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.078484 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.078486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.078486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:34.078495 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.080145 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.080566 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.080567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.080568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.080628 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.080891 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.080892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.080892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.081004 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.081081 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.081359 (+ 278us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.081455 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:49:34.081727 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.073043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45605 (local address 127.12.27.129:59731)
0929 22:49:34.073202 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.073245 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.073713 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.073934 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.073937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.074496 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:34.074684 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.074688 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.075343 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.075343 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.076207 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.076209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.076542 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.076543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.076636 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.077079 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:34.077087 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:34.078390 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:34.080248 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:34.080255 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:34.080257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:34.080485 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:34.080705 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:34.080706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:34.080707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:34.080817 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:34.081072 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:34.081079 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:34.081218 (+ 139us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.081335 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.081488 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260929 22:49:34.082190 29643 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45605
I20260929 22:49:34.082299 29643 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:34.082482 29643 heartbeater.cc:511] Master 127.12.27.190:45605 requested a full tablet report, sending...
I20260929 22:49:34.082989 29452 ts_manager.cc:194] Registered new tserver with Master: be5dd50cd8fe47d5aa6794872a1268c3 (127.12.27.129:44367)
I20260929 22:49:34.083607 29452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:59731
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:49:34.102771 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45605
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:34.181483 29648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:34.181677 29648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:34.181707 29648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:34.182865 29648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:34.182906 29648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:34.182932 29648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:34.184413 29648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:34.184650 29648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:34.184878 29648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:34.189961 29653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.190004 29648 server_base.cc:1034] running on GCE node
W20260929 22:49:34.189968 29654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.189968 29656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.190400 29648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:34.190645 29648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:34.191783 29648 hybrid_clock.cc:648] HybridClock initialized: now 1790722174191770 us; error 27 us; skew 500 ppm
Sep 29 22:49:34 dist-test-slave-00d6 krb5kdc[29407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:34.194208 29648 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:49:34.194640 29648 webserver.cc:460] Webserver started at http://127.12.27.130:40015/ using document root <none> and password file <none>
I20260929 22:49:34.194833 29648 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:34.194873 29648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:34.194958 29648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:34.196008 29648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "db563f90158c42b786fca542b0901e34"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "d5a0f18df71d5d697d3882ac137fc829"
server_key_iv: "8b23da0a0d3d17264de75884f854bb1a"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.196314 29648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "db563f90158c42b786fca542b0901e34"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "d5a0f18df71d5d697d3882ac137fc829"
server_key_iv: "8b23da0a0d3d17264de75884f854bb1a"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.197487 29648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:34.198107 29663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.198292 29648 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:34.198356 29648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "db563f90158c42b786fca542b0901e34"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "d5a0f18df71d5d697d3882ac137fc829"
server_key_iv: "8b23da0a0d3d17264de75884f854bb1a"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.198405 29648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:34.208232 29648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:34.209887 29648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:34.209993 29648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:34.210146 29648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:34.210394 29648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:34.210456 29648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.210479 29648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:34.210491 29648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.216341 29648 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:41485
I20260929 22:49:34.216404 29776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:41485 every 8 connection(s)
I20260929 22:49:34.216732 29648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:49:34.217180 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29648
I20260929 22:49:34.217279 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:49:34.217514 12398 external_mini_cluster.cc:1428] Setting key ff8adba7dd3777435712a8863955e203
Sep 29 22:49:34 dist-test-slave-00d6 krb5kdc[29407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
I20260929 22:49:34.226703 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.217740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:44319 (local address 127.12.27.190:45605)
0929 22:49:34.217807 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.217809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.217820 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:34.218245 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.218245 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.218274 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.218338 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.219236 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.219923 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.221150 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.221518 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.221603 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.223803 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.223805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.223805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:34.223814 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.225428 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.225806 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.225807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.225807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.225869 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.226122 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.226123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.226123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.226281 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.226359 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.226569 (+ 210us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.226638 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 22:49:34.226861 29779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.217441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45605 (local address 127.12.27.130:44319)
0929 22:49:34.217618 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.217661 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.218131 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.218402 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.218405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.218954 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:34.219129 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.219133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.220021 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.220022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.221059 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.221061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.221637 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.221638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.221792 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.222326 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:34.222333 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:34.223714 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:34.225509 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:34.225515 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:34.225516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:34.225731 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:34.225938 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:34.225938 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:34.225939 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:34.226072 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:34.226348 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:34.226352 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:34.226458 (+ 106us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.226537 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.226649 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260929 22:49:34.227409 29777 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45605
I20260929 22:49:34.227522 29777 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:34.227727 29777 heartbeater.cc:511] Master 127.12.27.190:45605 requested a full tablet report, sending...
I20260929 22:49:34.228099 29452 ts_manager.cc:194] Registered new tserver with Master: db563f90158c42b786fca542b0901e34 (127.12.27.130:41485)
I20260929 22:49:34.228478 29452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:44319
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:49:34.242929 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45605
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:34.323937 29782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:34.324124 29782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:34.324146 29782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:34.325205 29782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:34.325248 29782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:34.325273 29782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:34.326606 29782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:45605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:34.326777 29782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:34.326941 29782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:34.332057 29788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.332198 29782 server_base.cc:1034] running on GCE node
W20260929 22:49:34.332075 29790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.332286 29787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.332528 29782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:34.332770 29782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:34.333912 29782 hybrid_clock.cc:648] HybridClock initialized: now 1790722174333896 us; error 42 us; skew 500 ppm
Sep 29 22:49:34 dist-test-slave-00d6 krb5kdc[29407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:34.336398 29782 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:49:34.336870 29782 webserver.cc:460] Webserver started at http://127.12.27.131:44355/ using document root <none> and password file <none>
I20260929 22:49:34.337102 29782 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:34.337169 29782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:34.337327 29782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:34.338348 29782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "40e16892e80c40d3a22efdf9b5dd1e8d"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "7cb31245d72498d0330621225c292f27"
server_key_iv: "f5faa3aac099a32cccfc53499591cb90"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.338665 29782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "40e16892e80c40d3a22efdf9b5dd1e8d"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "7cb31245d72498d0330621225c292f27"
server_key_iv: "f5faa3aac099a32cccfc53499591cb90"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.340018 29782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 22:49:34.340726 29797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.340914 29782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:34.340981 29782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "40e16892e80c40d3a22efdf9b5dd1e8d"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "7cb31245d72498d0330621225c292f27"
server_key_iv: "f5faa3aac099a32cccfc53499591cb90"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.341070 29782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:34.380116 29782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:34.382004 29782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:34.382165 29782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:34.382407 29782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:34.382716 29782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:34.382767 29782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.382802 29782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:34.382829 29782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.389087 29782 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:42703
I20260929 22:49:34.389129 29910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:42703 every 8 connection(s)
I20260929 22:49:34.389442 29782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
Sep 29 22:49:34 dist-test-slave-00d6 krb5kdc[29407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:34.397867 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.390123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:55901 (local address 127.12.27.190:45605)
0929 22:49:34.390167 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.390169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.390419 (+ 250us) server_negotiation.cc:407] Connection header received
0929 22:49:34.390870 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.390871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.390882 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.390934 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.391893 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.392389 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.393320 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.393493 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.393542 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.395516 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.395517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.395517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:34.395524 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.396756 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.397103 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.397103 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.397104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.397150 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.397365 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.397365 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.397366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.397461 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.397509 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.397741 (+ 232us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.397798 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:49:34.398110 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29782
I20260929 22:49:34.398151 29913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.390125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:45605 (local address 127.12.27.131:55901)
0929 22:49:34.390293 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.390329 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.390790 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.391004 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.391007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.391568 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:34.391821 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.391826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.392464 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.392465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.393246 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.393248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.393561 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.393562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.393663 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.394112 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:34.394120 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:34.395435 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:34.396823 (+ 1388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:34.396828 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:34.396829 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:34.397037 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:34.397217 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:34.397217 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:34.397218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:34.397311 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:34.397513 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:34.397516 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:34.397620 (+ 104us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.397697 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.397896 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
I20260929 22:49:34.398190 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:49:34.398404 12398 external_mini_cluster.cc:1428] Setting key 5699386ffd0eb2fa192c0b087603050d
I20260929 22:49:34.398674 29911 heartbeater.cc:347] Connected to a master server at 127.12.27.190:45605
I20260929 22:49:34.398756 29911 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:34.398918 29911 heartbeater.cc:511] Master 127.12.27.190:45605 requested a full tablet report, sending...
I20260929 22:49:34.399351 29452 ts_manager.cc:194] Registered new tserver with Master: 40e16892e80c40d3a22efdf9b5dd1e8d (127.12.27.131:42703)
I20260929 22:49:34.399801 29452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:55901
I20260929 22:49:34.410126 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:49:34.417124 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.411431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.12.27.190:45605)
0929 22:49:34.411472 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.411475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.411581 (+ 106us) server_negotiation.cc:407] Connection header received
0929 22:49:34.411683 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.411684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.411694 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.411776 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.412386 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.412853 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.413583 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.413786 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.413833 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.414972 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.414973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.414973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:34.414979 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.416167 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.416478 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.416479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.416479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.416526 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:34.416682 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:34.416683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:34.416683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:34.416813 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.416885 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.416977 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.417032 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:49:34.418802 29452 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:49:34.420534 29452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:49:34.426869 29923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.422962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:42703 (local address 127.0.0.1:36768)
0929 22:49:34.423349 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.423359 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.423420 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.423687 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.423688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.423690 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:34.423735 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.423738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.424606 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.424607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.425853 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.425856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.426570 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426570 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.426648 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.426662 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.426726 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.426776 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":66,"threads_started":1}
I20260929 22:49:34.426997 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.422922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42350 (local address 127.12.27.130:41485)
0929 22:49:34.423098 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.423103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.423366 (+ 263us) server_negotiation.cc:407] Connection header received
0929 22:49:34.423413 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.423415 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.423430 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.423520 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:34.423764 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.424872 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.425930 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.426657 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426730 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.426790 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.426865 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.426904 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260929 22:49:34.427157 29927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.423163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36768 (local address 127.12.27.131:42703)
0929 22:49:34.423329 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.423333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.423405 (+ 72us) server_negotiation.cc:407] Connection header received
0929 22:49:34.423495 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.423497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.423514 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.423585 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:34.423817 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.424505 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.425946 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.426475 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426559 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.426616 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.427033 (+ 417us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.427072 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260929 22:49:34.427253 29925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.422792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41485 (local address 127.0.0.1:42350)
0929 22:49:34.423248 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.423257 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.423305 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.423598 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.423598 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.423600 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:34.423671 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.423673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.424973 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.424974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.425844 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.425846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.426751 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426751 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.426800 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.426803 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.426852 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.426882 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":2,"thread_start_us":67,"threads_started":1}
I20260929 22:49:34.427310 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.423006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.12.27.129:44367)
0929 22:49:34.423189 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.423194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.423204 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:34.423339 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.423342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.423357 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.423426 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:34.423695 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.424836 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426055 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.426729 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426788 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.426834 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.427180 (+ 346us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.427229 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":73,"threads_started":1}
I20260929 22:49:34.427120 29922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.422792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:44367 (local address 127.0.0.1:54594)
0929 22:49:34.423090 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.423129 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.423210 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.423515 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.423517 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.423520 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:34.423582 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.423583 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.424946 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.424947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.425981 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.425983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.426868 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.426870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.426939 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.426943 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.426993 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.427036 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":45,"threads_started":1}
I20260929 22:49:34.428058 29845 tablet_service.cc:1467] Processing CreateTablet for tablet acc69bfd70dc496abba89986597cce85 (DEFAULT_TABLE table=test-table [id=703ee2ce5cff44568a15d92db9b2f441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:34.428220 29711 tablet_service.cc:1467] Processing CreateTablet for tablet acc69bfd70dc496abba89986597cce85 (DEFAULT_TABLE table=test-table [id=703ee2ce5cff44568a15d92db9b2f441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:34.428239 29577 tablet_service.cc:1467] Processing CreateTablet for tablet acc69bfd70dc496abba89986597cce85 (DEFAULT_TABLE table=test-table [id=703ee2ce5cff44568a15d92db9b2f441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:34.428454 29845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc69bfd70dc496abba89986597cce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:34.428496 29711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc69bfd70dc496abba89986597cce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:34.428576 29577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc69bfd70dc496abba89986597cce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:34.431344 29928 tablet_bootstrap.cc:492] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: Bootstrap starting.
I20260929 22:49:34.432010 29928 tablet_bootstrap.cc:654] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:34.432565 29928 log.cc:824] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:34.432875 29929 tablet_bootstrap.cc:492] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Bootstrap starting.
I20260929 22:49:34.433248 29928 tablet_bootstrap.cc:492] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: No bootstrap required, opened a new log
I20260929 22:49:34.433305 29928 ts_tablet_manager.cc:1397] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:34.433506 29929 tablet_bootstrap.cc:654] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:34.434051 29929 log.cc:824] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:34.434333 29930 tablet_bootstrap.cc:492] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Bootstrap starting.
I20260929 22:49:34.434834 29930 tablet_bootstrap.cc:654] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:34.435086 29928 raft_consensus.cc:348] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.435218 29928 raft_consensus.cc:374] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:34.435240 29928 raft_consensus.cc:729] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5dd50cd8fe47d5aa6794872a1268c3, State: Initialized, Role: FOLLOWER
I20260929 22:49:34.435328 29930 log.cc:824] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:34.435362 29928 consensus_queue.cc:260] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.435673 29928 ts_tablet_manager.cc:1428] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:49:34.435693 29643 heartbeater.cc:503] Master 127.12.27.190:45605 was elected leader, sending a full tablet report...
I20260929 22:49:34.435945 29929 tablet_bootstrap.cc:492] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: No bootstrap required, opened a new log
I20260929 22:49:34.436028 29929 ts_tablet_manager.cc:1397] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 22:49:34.437510 29929 raft_consensus.cc:348] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.437656 29929 raft_consensus.cc:374] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:34.437700 29929 raft_consensus.cc:729] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e16892e80c40d3a22efdf9b5dd1e8d, State: Initialized, Role: FOLLOWER
I20260929 22:49:34.437811 29929 consensus_queue.cc:260] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.438073 29929 ts_tablet_manager.cc:1428] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:49:34.438127 29911 heartbeater.cc:503] Master 127.12.27.190:45605 was elected leader, sending a full tablet report...
I20260929 22:49:34.438472 29930 tablet_bootstrap.cc:492] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: No bootstrap required, opened a new log
I20260929 22:49:34.438539 29930 ts_tablet_manager.cc:1397] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260929 22:49:34.440007 29930 raft_consensus.cc:348] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.440151 29930 raft_consensus.cc:374] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:34.440197 29930 raft_consensus.cc:729] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db563f90158c42b786fca542b0901e34, State: Initialized, Role: FOLLOWER
I20260929 22:49:34.440299 29930 consensus_queue.cc:260] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.440563 29930 ts_tablet_manager.cc:1428] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:34.440569 29777 heartbeater.cc:503] Master 127.12.27.190:45605 was elected leader, sending a full tablet report...
W20260929 22:49:34.467298 29778 tablet.cc:2369] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:49:34.510951 29933 raft_consensus.cc:482] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:34.511077 29933 raft_consensus.cc:504] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.511545 29933 leader_election.cc:288] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e16892e80c40d3a22efdf9b5dd1e8d (127.12.27.131:42703), db563f90158c42b786fca542b0901e34 (127.12.27.130:41485)
I20260929 22:49:34.515507 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.511898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:51093 (local address 127.12.27.130:41485)
0929 22:49:34.511950 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.511952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.511962 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:34.512026 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.512027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.512053 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.512135 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:34.512332 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.513110 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.514501 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.515128 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.515205 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.515213 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.515399 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.515436 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:49:34.515507 29927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.511930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:57763 (local address 127.12.27.131:42703)
0929 22:49:34.511996 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.511998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.512345 (+ 347us) server_negotiation.cc:407] Connection header received
0929 22:49:34.512375 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.512376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.512386 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.512436 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:34.512576 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.513260 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.514556 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.515127 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.515205 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.515213 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.515399 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.515436 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 22:49:34.515532 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.511743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41485 (local address 127.12.27.129:51093)
0929 22:49:34.511818 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.511834 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.511897 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.512154 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.512156 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.512158 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:34.512236 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.512238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.513197 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.513198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.514414 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.514417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.515229 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.515230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.515319 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.515321 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.515379 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.515444 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":7}
I20260929 22:49:34.515537 29937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.511749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:42703 (local address 127.12.27.129:57763)
0929 22:49:34.512236 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.512247 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.512303 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.512452 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.512453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.512454 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:34.512504 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.512505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.513339 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.513339 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.514476 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.514478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.515229 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.515230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.515312 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.515316 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.515379 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.515444 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":304,"thread_start_us":153,"threads_started":1}
I20260929 22:49:34.515915 29731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc69bfd70dc496abba89986597cce85" candidate_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db563f90158c42b786fca542b0901e34" is_pre_election: true
I20260929 22:49:34.516091 29731 raft_consensus.cc:2454] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd50cd8fe47d5aa6794872a1268c3 in term 0.
I20260929 22:49:34.516006 29865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc69bfd70dc496abba89986597cce85" candidate_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" is_pre_election: true
I20260929 22:49:34.516211 29865 raft_consensus.cc:2454] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5dd50cd8fe47d5aa6794872a1268c3 in term 0.
I20260929 22:49:34.516345 29532 leader_election.cc:302] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be5dd50cd8fe47d5aa6794872a1268c3, db563f90158c42b786fca542b0901e34; no voters:
I20260929 22:49:34.516531 29933 raft_consensus.cc:2781] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:49:34.516613 29933 raft_consensus.cc:482] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:49:34.516650 29933 raft_consensus.cc:3037] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:34.517540 29933 raft_consensus.cc:504] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.517697 29933 leader_election.cc:288] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [CANDIDATE]: Term 1 election: Requested vote from peers 40e16892e80c40d3a22efdf9b5dd1e8d (127.12.27.131:42703), db563f90158c42b786fca542b0901e34 (127.12.27.130:41485)
I20260929 22:49:34.517834 29865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc69bfd70dc496abba89986597cce85" candidate_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d"
I20260929 22:49:34.517846 29731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc69bfd70dc496abba89986597cce85" candidate_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db563f90158c42b786fca542b0901e34"
I20260929 22:49:34.517918 29865 raft_consensus.cc:3037] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:34.517918 29731 raft_consensus.cc:3037] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:34.518782 29865 raft_consensus.cc:2454] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd50cd8fe47d5aa6794872a1268c3 in term 1.
I20260929 22:49:34.518790 29731 raft_consensus.cc:2454] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5dd50cd8fe47d5aa6794872a1268c3 in term 1.
I20260929 22:49:34.518985 29533 leader_election.cc:302] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e16892e80c40d3a22efdf9b5dd1e8d, be5dd50cd8fe47d5aa6794872a1268c3; no voters:
I20260929 22:49:34.519086 29933 raft_consensus.cc:2781] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:34.519270 29933 raft_consensus.cc:686] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 1 LEADER]: Becoming Leader. State: Replica: be5dd50cd8fe47d5aa6794872a1268c3, State: Running, Role: LEADER
I20260929 22:49:34.519383 29933 consensus_queue.cc:237] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } }
I20260929 22:49:34.520287 29451 catalog_manager.cc:5495] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to be5dd50cd8fe47d5aa6794872a1268c3 (127.12.27.129). New cstate: current_term: 1 leader_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5dd50cd8fe47d5aa6794872a1268c3" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 } health_report { overall_health: UNKNOWN } } }
I20260929 22:49:34.545285 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.542694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.12.27.129:44367)
0929 22:49:34.542759 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.542762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.542772 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:34.542876 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.542877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.542894 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.542970 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:49:34.543105 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.543615 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.544494 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.544696 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.544782 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.544942 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:49:34.545051 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:49:34.545143 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.545170 (+ 27us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.545191 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 22:49:34.547196 29731 raft_consensus.cc:1261] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 1 FOLLOWER]: Refusing update from remote peer be5dd50cd8fe47d5aa6794872a1268c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:34.547196 29865 raft_consensus.cc:1261] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 1 FOLLOWER]: Refusing update from remote peer be5dd50cd8fe47d5aa6794872a1268c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:34.547574 29938 consensus_queue.cc:1035] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db563f90158c42b786fca542b0901e34" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:34.547766 29933 consensus_queue.cc:1035] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e16892e80c40d3a22efdf9b5dd1e8d" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 42703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:34.550489 29942 mvcc.cc:205] Tried to move back new op lower bound from 7334798026942115840 to 7334798026832064512. Current Snapshot: MvccSnapshot[applied={T|T < 7334798026942115840}]
I20260929 22:49:34.550879 29943 mvcc.cc:205] Tried to move back new op lower bound from 7334798026942115840 to 7334798026832064512. Current Snapshot: MvccSnapshot[applied={T|T < 7334798026942115840}]
I20260929 22:49:34.552431 29452 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:34.552547 29452 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:34.553306 29452 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 11fbe0911a714b58a8998696d6bc3f01: Sending DeleteTablet for 3 replicas of tablet acc69bfd70dc496abba89986597cce85
I20260929 22:49:34.553602 29577 tablet_service.cc:1514] Processing DeleteTablet for tablet acc69bfd70dc496abba89986597cce85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:34 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:54594
I20260929 22:49:34.553646 29711 tablet_service.cc:1514] Processing DeleteTablet for tablet acc69bfd70dc496abba89986597cce85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:34 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:42350
I20260929 22:49:34.553841 29950 tablet_replica.cc:330] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3: stopping tablet replica
I20260929 22:49:34.553879 29951 tablet_replica.cc:330] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: stopping tablet replica
I20260929 22:49:34.553890 29845 tablet_service.cc:1514] Processing DeleteTablet for tablet acc69bfd70dc496abba89986597cce85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:34 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:36768
I20260929 22:49:34.553936 29950 raft_consensus.cc:2229] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:49:34.553970 29951 raft_consensus.cc:2229] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:34.554054 29950 raft_consensus.cc:2258] T acc69bfd70dc496abba89986597cce85 P be5dd50cd8fe47d5aa6794872a1268c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:34.554076 29951 raft_consensus.cc:2258] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:34.554497 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29514
I20260929 22:49:34.555150 29951 ts_tablet_manager.cc:1905] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:34.556787 29952 tablet_replica.cc:330] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: stopping tablet replica
I20260929 22:49:34.556916 29952 raft_consensus.cc:2229] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:34.557004 29951 ts_tablet_manager.cc:1918] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:34.557040 29952 raft_consensus.cc:2258] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:34.557082 29951 log.cc:1196] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/acc69bfd70dc496abba89986597cce85
I20260929 22:49:34.557413 29952 ts_tablet_manager.cc:1905] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:34.557479 29951 ts_tablet_manager.cc:1939] T acc69bfd70dc496abba89986597cce85 P db563f90158c42b786fca542b0901e34: Deleting consensus metadata
I20260929 22:49:34.557942 29438 catalog_manager.cc:4841] TS db563f90158c42b786fca542b0901e34 (127.12.27.130:41485): tablet acc69bfd70dc496abba89986597cce85 (table test-table [id=703ee2ce5cff44568a15d92db9b2f441]) successfully deleted
I20260929 22:49:34.558900 29952 ts_tablet_manager.cc:1918] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:34.558987 29952 log.cc:1196] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/acc69bfd70dc496abba89986597cce85
I20260929 22:49:34.559240 29952 ts_tablet_manager.cc:1939] T acc69bfd70dc496abba89986597cce85 P 40e16892e80c40d3a22efdf9b5dd1e8d: Deleting consensus metadata
I20260929 22:49:34.559680 29439 catalog_manager.cc:4841] TS 40e16892e80c40d3a22efdf9b5dd1e8d (127.12.27.131:42703): tablet acc69bfd70dc496abba89986597cce85 (table test-table [id=703ee2ce5cff44568a15d92db9b2f441]) successfully deleted
W20260929 22:49:34.560499 29439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:44367 (error 108)
I20260929 22:49:34.560716 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29648
I20260929 22:49:34.561291 29922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.560877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:44367 (local address 127.0.0.1:54612)
0929 22:49:34.561218 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.561253 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:44367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320}
W20260929 22:49:34.561458 29439 catalog_manager.cc:4584] TS be5dd50cd8fe47d5aa6794872a1268c3 (127.12.27.129:44367): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet acc69bfd70dc496abba89986597cce85: Network error: Client connection negotiation failed: client connection to 127.12.27.129:44367: connect: Connection refused (error 111)
I20260929 22:49:34.566432 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29782
I20260929 22:49:34.570729 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29420
2026-09-29T22:49:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1959 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-29T22:49:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:34Z Disabled control of system clock
I20260929 22:49:34.598549 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:43359
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:37935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:43359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:34.678846 29957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:34.679057 29957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:34.679078 29957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:34.680751 29957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:34.680796 29957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:34.680809 29957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:34.680842 29957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:34.680900 29957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:34.682880 29957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:43359
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:43359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:34.683151 29957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:34.683449 29957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:34.688385 29963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.688442 29962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.688486 29957 server_base.cc:1034] running on GCE node
W20260929 22:49:34.688467 29965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.688886 29957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:34.689179 29957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:34.690346 29957 hybrid_clock.cc:648] HybridClock initialized: now 1790722174690326 us; error 37 us; skew 500 ppm
I20260929 22:49:34.691834 29957 webserver.cc:460] Webserver started at http://127.12.27.190:42255/ using document root <none> and password file <none>
I20260929 22:49:34.692102 29957 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:34.692174 29957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:34.692341 29957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:34.693403 29957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "3e42496208bc49f59e06e535309211a9"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "bfb3a70a7c48f7fc22462ed7c5b90dfa"
server_key_iv: "49d62b433f735a685f3f022d599b4271"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.693780 29957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "3e42496208bc49f59e06e535309211a9"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "bfb3a70a7c48f7fc22462ed7c5b90dfa"
server_key_iv: "49d62b433f735a685f3f022d599b4271"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.695060 29957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:49:34.695827 29971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.695999 29957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:34.696103 29957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "3e42496208bc49f59e06e535309211a9"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "bfb3a70a7c48f7fc22462ed7c5b90dfa"
server_key_iv: "49d62b433f735a685f3f022d599b4271"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.696177 29957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:34.705422 29957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:34.705710 29957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:34.705864 29957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:34.709697 29957 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:43359
I20260929 22:49:34.709734 30023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:43359 every 8 connection(s)
I20260929 22:49:34.710067 29957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:34.710978 30024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:34.712678 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 29957
I20260929 22:49:34.712795 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:34.713002 12398 external_mini_cluster.cc:1428] Setting key 95998d205662ddd6086c04fdef9327d0
I20260929 22:49:34.713776 30024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9: Bootstrap starting.
I20260929 22:49:34.714355 30024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:34.714687 30024 log.cc:824] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:34.715390 30024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9: No bootstrap required, opened a new log
I20260929 22:49:34.717641 30024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e42496208bc49f59e06e535309211a9" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43359 } }
I20260929 22:49:34.717818 30024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:34.717864 30024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e42496208bc49f59e06e535309211a9, State: Initialized, Role: FOLLOWER
I20260929 22:49:34.718024 30024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e42496208bc49f59e06e535309211a9" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43359 } }
I20260929 22:49:34.718122 30024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:34.718156 30024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:34.718214 30024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:34.718786 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.713540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38526 (local address 127.12.27.190:43359)
0929 22:49:34.713751 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.713760 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.713797 (+ 37us) server_negotiation.cc:407] Connection header received
0929 22:49:34.714256 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.714262 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.714322 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.714486 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.714730 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.715874 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.716944 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.717329 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.717416 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.718170 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.718173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.718174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:34.718387 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.718419 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:34.718429 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.718480 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.718582 (+ 102us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.718641 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
I20260929 22:49:34.718930 30024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e42496208bc49f59e06e535309211a9" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43359 } }
I20260929 22:49:34.719054 30024 leader_election.cc:302] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e42496208bc49f59e06e535309211a9; no voters:
I20260929 22:49:34.719223 30024 leader_election.cc:288] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:34.719286 30029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:34.719417 30029 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 3e42496208bc49f59e06e535309211a9, State: Running, Role: LEADER
I20260929 22:49:34.719460 30024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:34.719497 30029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e42496208bc49f59e06e535309211a9" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43359 } }
I20260929 22:49:34.719874 30030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e42496208bc49f59e06e535309211a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e42496208bc49f59e06e535309211a9" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43359 } } }
I20260929 22:49:34.719880 30031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e42496208bc49f59e06e535309211a9. Latest consensus state: current_term: 1 leader_uuid: "3e42496208bc49f59e06e535309211a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e42496208bc49f59e06e535309211a9" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 43359 } } }
I20260929 22:49:34.719996 30030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:34.720005 30031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:34.720615 30038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:34.721180 30038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:34.722671 30038 catalog_manager.cc:1347] Generated new cluster ID: bc895dbc5bbe4189b3ce1612032cae85
I20260929 22:49:34.722723 30038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:34.735698 30038 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:34.736238 30038 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:34.741247 30038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9: Generated new TSK 0
I20260929 22:49:34.741421 30038 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:34.743952 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43359
--builtin_ntp_servers=127.12.27.148:37935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:34.824187 30048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:34.824373 30048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:34.824394 30048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:34.825510 30048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:34.825548 30048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:34.825573 30048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:34.826879 30048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:34.827096 30048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:34.827410 30048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:34.832334 30053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.832419 30056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.832357 30054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.832706 30048 server_base.cc:1034] running on GCE node
I20260929 22:49:34.832965 30048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:34.833209 30048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:34.834364 30048 hybrid_clock.cc:648] HybridClock initialized: now 1790722174834347 us; error 38 us; skew 500 ppm
I20260929 22:49:34.835618 30048 webserver.cc:460] Webserver started at http://127.12.27.129:41579/ using document root <none> and password file <none>
I20260929 22:49:34.835898 30048 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:34.835968 30048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:34.836099 30048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:34.837129 30048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "3e170ea48ff046ae9ab41a40edb669af"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "6037e74dc72f8a0d2fffcd8605778654"
server_key_iv: "f3a54124d9f448c6f51ecbd98c228ce5"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.837489 30048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "3e170ea48ff046ae9ab41a40edb669af"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "6037e74dc72f8a0d2fffcd8605778654"
server_key_iv: "f3a54124d9f448c6f51ecbd98c228ce5"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.838951 30048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:34.839810 30062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.840003 30048 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:34.840097 30048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "3e170ea48ff046ae9ab41a40edb669af"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "6037e74dc72f8a0d2fffcd8605778654"
server_key_iv: "f3a54124d9f448c6f51ecbd98c228ce5"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.840183 30048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:34.851233 30048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:34.851527 30048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:34.851719 30048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:34.851953 30048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:34.852283 30048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:34.852339 30048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.852381 30048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:34.852408 30048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.859346 30048 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:33377
I20260929 22:49:34.859431 30175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:33377 every 8 connection(s)
I20260929 22:49:34.859786 30048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:49:34.866253 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.860681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:40497 (local address 127.12.27.190:43359)
0929 22:49:34.860785 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.860787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.861038 (+ 251us) server_negotiation.cc:407] Connection header received
0929 22:49:34.862349 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.862351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.862369 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.862440 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.863318 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.864060 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.865046 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.865236 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.865289 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.866054 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.866055 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.866056 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:34.866060 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.866074 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:34.866077 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.866120 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.866168 (+ 48us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.866190 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260929 22:49:34.866509 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.860669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43359 (local address 127.12.27.129:40497)
0929 22:49:34.860894 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.860942 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.861644 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.862547 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.862552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.862563 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:34.863221 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.863228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.864145 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.864146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.864967 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.864970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.865312 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.865313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.865422 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.865923 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:34.865924 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:34.865953 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:34.865976 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:34.866121 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:34.866123 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:34.866126 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.866171 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.866255 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260929 22:49:34.867034 30176 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43359
I20260929 22:49:34.867142 30176 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:34.867322 30176 heartbeater.cc:511] Master 127.12.27.190:43359 requested a full tablet report, sending...
I20260929 22:49:34.867873 29988 ts_manager.cc:194] Registered new tserver with Master: 3e170ea48ff046ae9ab41a40edb669af (127.12.27.129:33377)
I20260929 22:49:34.868505 29988 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.129:40497
I20260929 22:49:34.869036 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30048
I20260929 22:49:34.869114 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:49:34.869336 12398 external_mini_cluster.cc:1428] Setting key 4a1dcd67ed05a02705d5e7ac2f5dac7e
I20260929 22:49:34.870208 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43359
--builtin_ntp_servers=127.12.27.148:37935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:34.951108 30179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:34.951323 30179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:34.951344 30179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:34.952562 30179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:34.952605 30179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:34.952629 30179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:34.953971 30179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:34.954231 30179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:34.954531 30179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:34.959555 30187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:34.959529 30185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.959612 30179 server_base.cc:1034] running on GCE node
W20260929 22:49:34.959523 30184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:34.959986 30179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:34.960246 30179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:34.961392 30179 hybrid_clock.cc:648] HybridClock initialized: now 1790722174961381 us; error 33 us; skew 500 ppm
I20260929 22:49:34.962621 30179 webserver.cc:460] Webserver started at http://127.12.27.130:35767/ using document root <none> and password file <none>
I20260929 22:49:34.962881 30179 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:34.962929 30179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:34.963104 30179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:34.964255 30179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "373adf5fa374467596f3e894f9939acb"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "43e212044ff31f964f4dd8922d7a0b5c"
server_key_iv: "34469c693abb84ba837bd5f556c8fc0a"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.964615 30179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "373adf5fa374467596f3e894f9939acb"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "43e212044ff31f964f4dd8922d7a0b5c"
server_key_iv: "34469c693abb84ba837bd5f556c8fc0a"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.965907 30179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:49:34.966594 30193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.966771 30179 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:49:34.966861 30179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "373adf5fa374467596f3e894f9939acb"
format_stamp: "Formatted at 2026-09-29 22:49:34 on dist-test-slave-00d6"
server_key: "43e212044ff31f964f4dd8922d7a0b5c"
server_key_iv: "34469c693abb84ba837bd5f556c8fc0a"
server_key_version: "encryptionkey@0"
I20260929 22:49:34.966934 30179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:34.980623 30179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:34.980919 30179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:34.981066 30179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:34.981299 30179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:34.981639 30179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:34.981696 30179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.981740 30179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:34.981768 30179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:34.987617 30179 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:35709
I20260929 22:49:34.987689 30306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:35709 every 8 connection(s)
I20260929 22:49:34.987990 30179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:49:34.993242 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.988689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:53437 (local address 127.12.27.190:43359)
0929 22:49:34.988767 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:34.988769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:34.988980 (+ 211us) server_negotiation.cc:407] Connection header received
0929 22:49:34.989511 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:34.989513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:34.989526 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:34.989581 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:34.990276 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.990784 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.991775 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.991976 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.992075 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.992946 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:34.992947 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:34.992948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:34.992953 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:34.992968 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:34.992972 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:34.993025 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:34.993125 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 22:49:34.993153 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 22:49:34.993453 30309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:34.988692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43359 (local address 127.12.27.130:53437)
0929 22:49:34.988861 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:34.988893 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:34.989401 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:34.989656 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:34.989659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:34.989667 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:34.990175 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.990181 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.990882 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.990883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.991673 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:34.991675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:34.992084 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:34.992085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:34.992227 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:34.992800 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:34.992801 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:34.992829 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:34.992850 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:34.993032 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:34.993037 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:34.993040 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:34.993127 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 22:49:34.993230 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260929 22:49:34.993927 30307 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43359
I20260929 22:49:34.994033 30307 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:34.994215 30307 heartbeater.cc:511] Master 127.12.27.190:43359 requested a full tablet report, sending...
I20260929 22:49:34.994601 29988 ts_manager.cc:194] Registered new tserver with Master: 373adf5fa374467596f3e894f9939acb (127.12.27.130:35709)
I20260929 22:49:34.994705 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30179
I20260929 22:49:34.994828 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:49:34.995040 12398 external_mini_cluster.cc:1428] Setting key 69c8382e65d935bc6567f2b807502176
I20260929 22:49:34.995051 29988 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.130:53437
I20260929 22:49:34.996058 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43359
--builtin_ntp_servers=127.12.27.148:37935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:35.076152 30310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:35.076377 30310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:35.076413 30310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:35.077543 30310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:35.077610 30310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:35.077654 30310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:35.078979 30310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:43359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:35.079247 30310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:35.079533 30310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:35.084414 30316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:35.084434 30315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:35.084414 30318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:35.084594 30310 server_base.cc:1034] running on GCE node
I20260929 22:49:35.084817 30310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:35.085059 30310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:35.086205 30310 hybrid_clock.cc:648] HybridClock initialized: now 1790722175086185 us; error 28 us; skew 500 ppm
I20260929 22:49:35.087384 30310 webserver.cc:460] Webserver started at http://127.12.27.131:40815/ using document root <none> and password file <none>
I20260929 22:49:35.087662 30310 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:35.087742 30310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:35.087899 30310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:35.088912 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "602f44b05764456c86c7f0f83090f697"
format_stamp: "Formatted at 2026-09-29 22:49:35 on dist-test-slave-00d6"
server_key: "3a21124cf42db3e0dab044483c14a9dc"
server_key_iv: "07538827fbc2ababba3816a0ef8b8795"
server_key_version: "encryptionkey@0"
I20260929 22:49:35.089269 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "602f44b05764456c86c7f0f83090f697"
format_stamp: "Formatted at 2026-09-29 22:49:35 on dist-test-slave-00d6"
server_key: "3a21124cf42db3e0dab044483c14a9dc"
server_key_iv: "07538827fbc2ababba3816a0ef8b8795"
server_key_version: "encryptionkey@0"
I20260929 22:49:35.090538 30310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:49:35.091387 30324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:35.091567 30310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:35.091687 30310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "602f44b05764456c86c7f0f83090f697"
format_stamp: "Formatted at 2026-09-29 22:49:35 on dist-test-slave-00d6"
server_key: "3a21124cf42db3e0dab044483c14a9dc"
server_key_iv: "07538827fbc2ababba3816a0ef8b8795"
server_key_version: "encryptionkey@0"
I20260929 22:49:35.091774 30310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:35.102067 30310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:35.102344 30310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:35.102487 30310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:35.102694 30310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:35.103019 30310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:35.103082 30310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:35.103121 30310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:35.103149 30310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:35.108670 30310 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38151
I20260929 22:49:35.108721 30437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38151 every 8 connection(s)
I20260929 22:49:35.109016 30310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:49:35.110601 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30310
I20260929 22:49:35.110713 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:49:35.110944 12398 external_mini_cluster.cc:1428] Setting key 100b3866de0799caf09a6e62163e83f6
I20260929 22:49:35.114428 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.109684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:50951 (local address 127.12.27.190:43359)
0929 22:49:35.109767 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.109769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.109953 (+ 184us) server_negotiation.cc:407] Connection header received
0929 22:49:35.110410 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.110412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.110425 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.110494 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:35.111413 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.112099 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.113071 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.113293 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.113382 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.114148 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:35.114149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:35.114149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:35.114154 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:35.114176 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:35.114180 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:35.114247 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.114326 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.114352 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 22:49:35.114630 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.109645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:43359 (local address 127.12.27.131:50951)
0929 22:49:35.109842 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.109873 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:35.110324 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:35.110572 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:35.110578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:35.110588 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:35.111319 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.111325 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.112181 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.112182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.112974 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.112976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.113393 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.113394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.113531 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.114016 (+ 485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:35.114017 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:35.114043 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:35.114063 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:35.114247 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:35.114253 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:35.114256 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:35.114328 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 22:49:35.114425 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260929 22:49:35.115103 30438 heartbeater.cc:347] Connected to a master server at 127.12.27.190:43359
I20260929 22:49:35.115188 30438 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:35.115317 30438 heartbeater.cc:511] Master 127.12.27.190:43359 requested a full tablet report, sending...
I20260929 22:49:35.115717 29988 ts_manager.cc:194] Registered new tserver with Master: 602f44b05764456c86c7f0f83090f697 (127.12.27.131:38151)
I20260929 22:49:35.116031 29988 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.131:50951
I20260929 22:49:35.122757 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:49:35.126696 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.124115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38530 (local address 127.12.27.190:43359)
0929 22:49:35.124168 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.124170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.124280 (+ 110us) server_negotiation.cc:407] Connection header received
0929 22:49:35.124318 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.124319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.124327 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.124376 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:35.124513 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.124961 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.125654 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.125834 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.125886 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.126522 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:35.126523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:35.126523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:35.126526 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:35.126536 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:35.126539 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:35.126577 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.126619 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.126634 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 22:49:35.128186 29988 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:49:35.129716 29988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:49:35.135762 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.131746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:33377 (local address 127.0.0.1:36634)
0929 22:49:35.131886 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.131948 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:35.132015 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:35.132584 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:35.132584 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:35.132587 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:35.132630 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.132632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.133499 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.133500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.134465 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.134468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.135457 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.135458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.135510 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.135543 (+ 33us) client_negotiation.cc:769] Sending connection context
0929 22:49:35.135610 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 22:49:35.135687 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":57,"threads_started":1}
I20260929 22:49:35.135854 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.132000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39972 (local address 127.12.27.130:35709)
0929 22:49:35.132361 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.132364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.132373 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:35.132405 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.132407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.132419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.132512 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:35.132675 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.133799 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.134936 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.135482 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.135555 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.135659 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.135735 (+ 76us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.135770 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":103,"threads_started":1}
I20260929 22:49:35.135838 30446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.131750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:35709 (local address 127.0.0.1:39972)
0929 22:49:35.131984 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.131995 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:35.132058 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:35.132518 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:35.132520 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:35.132522 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:35.132582 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.132583 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.133895 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.133895 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.134848 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.134850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.135565 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.135566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.135656 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.135667 (+ 11us) client_negotiation.cc:769] Sending connection context
0929 22:49:35.135712 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:49:35.135743 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":93,"threads_started":1}
I20260929 22:49:35.136462 30451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.132206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36634 (local address 127.12.27.129:33377)
0929 22:49:35.132363 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.132366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.132375 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:35.132406 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.132407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.132419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.132515 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:35.132730 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.133406 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.134563 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.135276 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.135338 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.135429 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.136328 (+ 899us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.136374 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
I20260929 22:49:35.136507 30448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.131753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38151 (local address 127.0.0.1:41142)
0929 22:49:35.132675 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.132685 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:35.132732 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:35.132953 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:35.132954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:35.132956 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:35.132994 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.132995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.134177 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.134178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.135252 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.135255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.136256 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.136257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.136317 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.136321 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:35.136403 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 22:49:35.136441 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":84,"threads_started":1}
I20260929 22:49:35.136837 30241 tablet_service.cc:1467] Processing CreateTablet for tablet 14b78731a18c4d85b0708ac65a00597d (DEFAULT_TABLE table=test-table [id=3d3edf4b9227466ba5ca51eeed672d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:35.137130 30110 tablet_service.cc:1467] Processing CreateTablet for tablet 14b78731a18c4d85b0708ac65a00597d (DEFAULT_TABLE table=test-table [id=3d3edf4b9227466ba5ca51eeed672d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:35.137217 30241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14b78731a18c4d85b0708ac65a00597d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:35.137435 30110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14b78731a18c4d85b0708ac65a00597d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:35.139775 30453 tablet_bootstrap.cc:492] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af: Bootstrap starting.
I20260929 22:49:35.140123 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.131982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41142 (local address 127.12.27.131:38151)
0929 22:49:35.132623 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.132626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.132783 (+ 157us) server_negotiation.cc:407] Connection header received
0929 22:49:35.132819 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.132821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.132834 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.132898 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:35.133061 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.134086 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.135346 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.136061 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.136172 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.136258 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.139988 (+ 3730us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.140041 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":83,"threads_started":1}
I20260929 22:49:35.140111 30452 tablet_bootstrap.cc:492] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Bootstrap starting.
I20260929 22:49:35.140442 30453 tablet_bootstrap.cc:654] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:35.140710 30452 tablet_bootstrap.cc:654] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:35.140764 30453 log.cc:824] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:35.140751 30372 tablet_service.cc:1467] Processing CreateTablet for tablet 14b78731a18c4d85b0708ac65a00597d (DEFAULT_TABLE table=test-table [id=3d3edf4b9227466ba5ca51eeed672d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:35.141041 30452 log.cc:824] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:35.141067 30372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14b78731a18c4d85b0708ac65a00597d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:35.141523 30453 tablet_bootstrap.cc:492] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af: No bootstrap required, opened a new log
I20260929 22:49:35.141680 30453 ts_tablet_manager.cc:1397] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:35.141697 30452 tablet_bootstrap.cc:492] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: No bootstrap required, opened a new log
I20260929 22:49:35.141741 30452 ts_tablet_manager.cc:1397] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:49:35.143927 30452 raft_consensus.cc:348] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.144073 30452 raft_consensus.cc:374] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:35.144115 30452 raft_consensus.cc:729] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373adf5fa374467596f3e894f9939acb, State: Initialized, Role: FOLLOWER
I20260929 22:49:35.144234 30452 consensus_queue.cc:260] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.144379 30453 raft_consensus.cc:348] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.144495 30452 ts_tablet_manager.cc:1428] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:49:35.144531 30453 raft_consensus.cc:374] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:35.144556 30453 raft_consensus.cc:729] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e170ea48ff046ae9ab41a40edb669af, State: Initialized, Role: FOLLOWER
I20260929 22:49:35.144642 30307 heartbeater.cc:503] Master 127.12.27.190:43359 was elected leader, sending a full tablet report...
I20260929 22:49:35.144691 30453 consensus_queue.cc:260] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.144940 30453 ts_tablet_manager.cc:1428] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:49:35.145021 30176 heartbeater.cc:503] Master 127.12.27.190:43359 was elected leader, sending a full tablet report...
I20260929 22:49:35.145148 30456 tablet_bootstrap.cc:492] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Bootstrap starting.
I20260929 22:49:35.145776 30456 tablet_bootstrap.cc:654] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:35.146060 30456 log.cc:824] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:35.146772 30456 tablet_bootstrap.cc:492] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: No bootstrap required, opened a new log
I20260929 22:49:35.146842 30456 ts_tablet_manager.cc:1397] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:49:35.148631 30456 raft_consensus.cc:348] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.148748 30456 raft_consensus.cc:374] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:35.148769 30456 raft_consensus.cc:729] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 602f44b05764456c86c7f0f83090f697, State: Initialized, Role: FOLLOWER
I20260929 22:49:35.148872 30456 consensus_queue.cc:260] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.149122 30456 ts_tablet_manager.cc:1428] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:49:35.149154 30438 heartbeater.cc:503] Master 127.12.27.190:43359 was elected leader, sending a full tablet report...
W20260929 22:49:35.238507 30308 tablet.cc:2369] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:49:35.274761 30460 raft_consensus.cc:482] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:35.274969 30460 raft_consensus.cc:504] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.275432 30460 leader_election.cc:288] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e170ea48ff046ae9ab41a40edb669af (127.12.27.129:33377), 373adf5fa374467596f3e894f9939acb (127.12.27.130:35709)
I20260929 22:49:35.278270 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.275701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:53107 (local address 127.12.27.130:35709)
0929 22:49:35.275747 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.275749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.275760 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:35.275800 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.275801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.275812 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.275876 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:35.276086 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.276570 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.277563 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.277918 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.278002 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.278011 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.278163 (+ 152us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.278202 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:49:35.278270 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.275596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:35709 (local address 127.12.27.131:53107)
0929 22:49:35.275670 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.275683 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:35.275727 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:35.275912 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:35.275913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:35.275915 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:35.275988 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.275990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.276659 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.276660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.277456 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.277459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.278011 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.278013 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.278090 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.278093 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:35.278158 (+ 65us) client_negotiation.cc:240] Negotiation successful
0929 22:49:35.278201 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260929 22:49:35.278354 30451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.275729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:55479 (local address 127.12.27.129:33377)
0929 22:49:35.275787 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.275788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.275869 (+ 81us) server_negotiation.cc:407] Connection header received
0929 22:49:35.275939 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.275941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.275953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.276035 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:35.276191 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.276665 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.277622 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.277987 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.278076 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.278083 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.278242 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.278282 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:49:35.278393 30461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.275598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:33377 (local address 127.12.27.131:55479)
0929 22:49:35.275820 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.275829 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:35.275872 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:35.276038 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:35.276039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:35.276041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:35.276117 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.276118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.276790 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.276791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.277523 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:35.277525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.278076 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.278077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:35.278155 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.278158 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:35.278228 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:49:35.278267 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":65,"thread_start_us":109,"threads_started":1}
I20260929 22:49:35.278667 30261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14b78731a18c4d85b0708ac65a00597d" candidate_uuid: "602f44b05764456c86c7f0f83090f697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373adf5fa374467596f3e894f9939acb" is_pre_election: true
I20260929 22:49:35.278713 30130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14b78731a18c4d85b0708ac65a00597d" candidate_uuid: "602f44b05764456c86c7f0f83090f697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e170ea48ff046ae9ab41a40edb669af" is_pre_election: true
I20260929 22:49:35.278820 30261 raft_consensus.cc:2454] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 602f44b05764456c86c7f0f83090f697 in term 0.
I20260929 22:49:35.278888 30130 raft_consensus.cc:2454] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 602f44b05764456c86c7f0f83090f697 in term 0.
I20260929 22:49:35.279060 30328 leader_election.cc:302] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373adf5fa374467596f3e894f9939acb, 602f44b05764456c86c7f0f83090f697; no voters:
I20260929 22:49:35.279232 30460 raft_consensus.cc:2781] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:49:35.279273 30460 raft_consensus.cc:482] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:49:35.279287 30460 raft_consensus.cc:3037] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:35.280033 30460 raft_consensus.cc:504] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.280181 30460 leader_election.cc:288] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [CANDIDATE]: Term 1 election: Requested vote from peers 3e170ea48ff046ae9ab41a40edb669af (127.12.27.129:33377), 373adf5fa374467596f3e894f9939acb (127.12.27.130:35709)
I20260929 22:49:35.280300 30130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14b78731a18c4d85b0708ac65a00597d" candidate_uuid: "602f44b05764456c86c7f0f83090f697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e170ea48ff046ae9ab41a40edb669af"
I20260929 22:49:35.280354 30261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14b78731a18c4d85b0708ac65a00597d" candidate_uuid: "602f44b05764456c86c7f0f83090f697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373adf5fa374467596f3e894f9939acb"
I20260929 22:49:35.280381 30130 raft_consensus.cc:3037] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:35.280459 30261 raft_consensus.cc:3037] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:35.281153 30130 raft_consensus.cc:2454] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 602f44b05764456c86c7f0f83090f697 in term 1.
I20260929 22:49:35.281366 30326 leader_election.cc:302] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e170ea48ff046ae9ab41a40edb669af, 602f44b05764456c86c7f0f83090f697; no voters:
I20260929 22:49:35.281383 30261 raft_consensus.cc:2454] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 602f44b05764456c86c7f0f83090f697 in term 1.
I20260929 22:49:35.281487 30460 raft_consensus.cc:2781] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:35.281657 30460 raft_consensus.cc:686] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 1 LEADER]: Becoming Leader. State: Replica: 602f44b05764456c86c7f0f83090f697, State: Running, Role: LEADER
I20260929 22:49:35.281778 30460 consensus_queue.cc:237] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } }
I20260929 22:49:35.282661 29988 catalog_manager.cc:5495] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 602f44b05764456c86c7f0f83090f697 (127.12.27.131). New cstate: current_term: 1 leader_uuid: "602f44b05764456c86c7f0f83090f697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "602f44b05764456c86c7f0f83090f697" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38151 } health_report { overall_health: HEALTHY } } }
I20260929 22:49:35.316252 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.313801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41158 (local address 127.12.27.131:38151)
0929 22:49:35.313874 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:35.313876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:35.313884 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:49:35.313925 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:35.313926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:35.313951 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:35.314030 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:49:35.314184 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.314652 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.315422 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:35.315674 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:35.315736 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:35.315907 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:49:35.316018 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:49:35.316111 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:35.316130 (+ 19us) server_negotiation.cc:299] Negotiation successful
0929 22:49:35.316146 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:49:35.318006 30261 raft_consensus.cc:1261] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 1 FOLLOWER]: Refusing update from remote peer 602f44b05764456c86c7f0f83090f697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:35.318048 30130 raft_consensus.cc:1261] T 14b78731a18c4d85b0708ac65a00597d P 3e170ea48ff046ae9ab41a40edb669af [term 1 FOLLOWER]: Refusing update from remote peer 602f44b05764456c86c7f0f83090f697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:35.318379 30460 consensus_queue.cc:1035] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e170ea48ff046ae9ab41a40edb669af" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 33377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:35.318498 30462 consensus_queue.cc:1035] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "373adf5fa374467596f3e894f9939acb" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:35.321976 30466 mvcc.cc:205] Tried to move back new op lower bound from 7334798030100000768 to 7334798029955035136. Current Snapshot: MvccSnapshot[applied={T|T < 7334798030100000768 or (T in {7334798030100000768})}]
I20260929 22:49:35.323350 29988 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:35.323469 29988 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:35.324276 29988 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e42496208bc49f59e06e535309211a9: Sending DeleteTablet for 3 replicas of tablet 14b78731a18c4d85b0708ac65a00597d
I20260929 22:49:35.324604 30372 tablet_service.cc:1514] Processing DeleteTablet for tablet 14b78731a18c4d85b0708ac65a00597d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:35 UTC) from {username='slave'} at 127.0.0.1:41142
I20260929 22:49:35.324602 30110 tablet_service.cc:1514] Processing DeleteTablet for tablet 14b78731a18c4d85b0708ac65a00597d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:35 UTC) from {username='slave'} at 127.0.0.1:36634
I20260929 22:49:35.324836 30475 tablet_replica.cc:330] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: stopping tablet replica
I20260929 22:49:35.324901 30241 tablet_service.cc:1514] Processing DeleteTablet for tablet 14b78731a18c4d85b0708ac65a00597d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:35 UTC) from {username='slave'} at 127.0.0.1:39972
I20260929 22:49:35.324939 30475 raft_consensus.cc:2229] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:49:35.325033 30475 raft_consensus.cc:2258] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:35.325153 30476 tablet_replica.cc:330] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: stopping tablet replica
I20260929 22:49:35.325309 30476 raft_consensus.cc:2229] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:35.325412 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30048
I20260929 22:49:35.325522 30475 ts_tablet_manager.cc:1905] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:35.326221 30476 raft_consensus.cc:2258] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:35.326687 30476 ts_tablet_manager.cc:1905] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:35.327509 30475 ts_tablet_manager.cc:1918] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:35.327587 30475 log.cc:1196] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/14b78731a18c4d85b0708ac65a00597d
I20260929 22:49:35.327874 30475 ts_tablet_manager.cc:1939] T 14b78731a18c4d85b0708ac65a00597d P 602f44b05764456c86c7f0f83090f697: Deleting consensus metadata
I20260929 22:49:35.328261 29972 catalog_manager.cc:4841] TS 602f44b05764456c86c7f0f83090f697 (127.12.27.131:38151): tablet 14b78731a18c4d85b0708ac65a00597d (table test-table [id=3d3edf4b9227466ba5ca51eeed672d0f]) successfully deleted
I20260929 22:49:35.328665 30476 ts_tablet_manager.cc:1918] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:35.328787 30476 log.cc:1196] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/14b78731a18c4d85b0708ac65a00597d
I20260929 22:49:35.329099 30476 ts_tablet_manager.cc:1939] T 14b78731a18c4d85b0708ac65a00597d P 373adf5fa374467596f3e894f9939acb: Deleting consensus metadata
I20260929 22:49:35.329540 29975 catalog_manager.cc:4841] TS 373adf5fa374467596f3e894f9939acb (127.12.27.130:35709): tablet 14b78731a18c4d85b0708ac65a00597d (table test-table [id=3d3edf4b9227466ba5ca51eeed672d0f]) successfully deleted
W20260929 22:49:35.332052 29973 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:33377 (error 108)
I20260929 22:49:35.332567 30448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:35.332418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:33377 (local address 127.0.0.1:36650)
0929 22:49:35.332483 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:35.332531 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260929 22:49:35.332616 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30179
W20260929 22:49:35.335105 29973 catalog_manager.cc:4584] TS 3e170ea48ff046ae9ab41a40edb669af (127.12.27.129:33377): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 14b78731a18c4d85b0708ac65a00597d: Network error: Client connection negotiation failed: client connection to 127.12.27.129:33377: connect: Connection refused (error 111)
I20260929 22:49:35.338311 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30310
I20260929 22:49:35.342701 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 29957
2026-09-29T22:49:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (770 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:35 dist-test-slave-00d6 krb5kdc[30480](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:35 dist-test-slave-00d6 krb5kdc[30480](info): set up 2 sockets
Sep 29 22:49:35 dist-test-slave-00d6 krb5kdc[30480](info): commencing operation
krb5kdc: starting...
W20260929 22:49:36.383966 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:49:36.500363 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39145
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:46719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:39145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:36.583132 30493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:36.583461 30493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:36.583516 30493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:36.585444 30493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:36.585534 30493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:36.585561 30493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:36.585579 30493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:36.585598 30493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:36.588006 30493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:46719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:39145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:39145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:36.588231 30493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:36.588418 30493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:36.593457 30501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:36.593448 30498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:36.593567 30493 server_base.cc:1034] running on GCE node
W20260929 22:49:36.593423 30499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:36.594002 30493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:36.594312 30493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:36.595480 30493 hybrid_clock.cc:648] HybridClock initialized: now 1790722176595477 us; error 39 us; skew 500 ppm
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:36.598059 30493 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:49:36.598453 30493 webserver.cc:460] Webserver started at http://127.12.27.190:40455/ using document root <none> and password file <none>
I20260929 22:49:36.598626 30493 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:36.598665 30493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:36.598754 30493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:36.599830 30493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "6373b1a28721488c91bd65dc7d8aa7a4"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "4cf014001335cda01d92989d14a51274"
server_key_iv: "3a8e791426de566b16d989d8aa2c657a"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.600126 30493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "6373b1a28721488c91bd65dc7d8aa7a4"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "4cf014001335cda01d92989d14a51274"
server_key_iv: "3a8e791426de566b16d989d8aa2c657a"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.601370 30493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:36.602012 30508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.602193 30493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.602283 30493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "6373b1a28721488c91bd65dc7d8aa7a4"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "4cf014001335cda01d92989d14a51274"
server_key_iv: "3a8e791426de566b16d989d8aa2c657a"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.602358 30493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:36.611093 30493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:36.613384 30493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:36.613530 30493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:36.617476 30493 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:39145
I20260929 22:49:36.617506 30560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:39145 every 8 connection(s)
I20260929 22:49:36.617853 30493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:36.618692 30561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:36.620920 30561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4: Bootstrap starting.
I20260929 22:49:36.621433 30561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:36.621654 30561 log.cc:824] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:36.622298 30561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4: No bootstrap required, opened a new log
I20260929 22:49:36.623912 30561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39145 } }
I20260929 22:49:36.624042 30561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:36.624064 30561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6373b1a28721488c91bd65dc7d8aa7a4, State: Initialized, Role: FOLLOWER
I20260929 22:49:36.624199 30561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39145 } }
I20260929 22:49:36.624287 30561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:36.624310 30561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:36.624341 30561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:36.624816 30561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39145 } }
I20260929 22:49:36.624909 30561 leader_election.cc:302] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6373b1a28721488c91bd65dc7d8aa7a4; no voters:
I20260929 22:49:36.625111 30561 leader_election.cc:288] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:36.625139 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30493
I20260929 22:49:36.625144 30564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:36.625245 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:36.625308 30564 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [term 1 LEADER]: Becoming Leader. State: Replica: 6373b1a28721488c91bd65dc7d8aa7a4, State: Running, Role: LEADER
I20260929 22:49:36.625382 30561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:36.625466 12398 external_mini_cluster.cc:1428] Setting key 66da3e2a391fe78a37b8b2b73e8f385e
I20260929 22:49:36.625396 30564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39145 } }
I20260929 22:49:36.625885 30564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6373b1a28721488c91bd65dc7d8aa7a4. Latest consensus state: current_term: 1 leader_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39145 } } }
I20260929 22:49:36.625968 30564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:36.626158 30565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6373b1a28721488c91bd65dc7d8aa7a4" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 39145 } } }
I20260929 22:49:36.626276 30565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:36.626627 30572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:36.627154 30572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:36.630165 30572 catalog_manager.cc:1347] Generated new cluster ID: 6a740101b24e41fba2e8aeff54a172e7
I20260929 22:49:36.630224 30572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:36.634886 30572 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:36.635371 30572 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:36.638274 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:36.626542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.12.27.190:39145)
0929 22:49:36.626728 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:36.626737 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:36.626921 (+ 184us) server_negotiation.cc:407] Connection header received
0929 22:49:36.627113 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:36.627119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:36.627175 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:36.627379 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:36.628152 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.629520 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.630610 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.631024 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.631138 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:36.633420 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:36.633424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:36.633424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:36.633435 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:36.636655 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:36.637052 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:36.637055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:36.637055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:36.637163 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:36.637372 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:36.637373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:36.637373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:36.637657 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:36.637828 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:36.637903 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 22:49:36.638054 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":79,"threads_started":1}
I20260929 22:49:36.644788 30572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4: Generated new TSK 0
I20260929 22:49:36.644963 30572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:49:36.675895 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39145
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:46719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:36.775591 30587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:36.775858 30587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:36.775883 30587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:36.777024 30587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:36.777064 30587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:36.777091 30587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:36.778509 30587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:46719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:36.778743 30587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:36.778997 30587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:36.783902 30593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:36.783914 30592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:36.783908 30595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:36.784123 30587 server_base.cc:1034] running on GCE node
I20260929 22:49:36.784318 30587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:36.784546 30587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:36.785688 30587 hybrid_clock.cc:648] HybridClock initialized: now 1790722176785674 us; error 29 us; skew 500 ppm
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:36.788136 30587 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:49:36.788547 30587 webserver.cc:460] Webserver started at http://127.12.27.129:41793/ using document root <none> and password file <none>
I20260929 22:49:36.788789 30587 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:36.788834 30587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:36.788996 30587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:36.790099 30587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "03cdb67c6ea84da79c62e74ae102f2bd"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "929e243d5763df3b38bad109d5591a09"
server_key_iv: "f3bb89baaf79fe4b5bfa86540c5a4c22"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.790445 30587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "03cdb67c6ea84da79c62e74ae102f2bd"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "929e243d5763df3b38bad109d5591a09"
server_key_iv: "f3bb89baaf79fe4b5bfa86540c5a4c22"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.791742 30587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:49:36.792480 30602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.792660 30587 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:36.792742 30587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "03cdb67c6ea84da79c62e74ae102f2bd"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "929e243d5763df3b38bad109d5591a09"
server_key_iv: "f3bb89baaf79fe4b5bfa86540c5a4c22"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.792829 30587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:36.803970 30587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:36.805792 30587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:36.805949 30587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:36.806193 30587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:36.806489 30587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:36.806541 30587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.806581 30587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:36.806610 30587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.812269 30587 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:44765
I20260929 22:49:36.812326 30716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:44765 every 8 connection(s)
I20260929 22:49:36.812610 30587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:36.821218 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:36.813299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:45099 (local address 127.12.27.190:39145)
0929 22:49:36.813360 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:36.813362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:36.813579 (+ 217us) server_negotiation.cc:407] Connection header received
0929 22:49:36.814024 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:36.814025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:36.814035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:36.814082 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:36.814957 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.815444 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.816428 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.816612 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.816661 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:36.818870 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:36.818871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:36.818871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:36.818877 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:36.820118 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:36.820469 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:36.820470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:36.820470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:36.820518 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:36.820721 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:36.820721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:36.820721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:36.820820 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:36.820870 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:36.821091 (+ 221us) server_negotiation.cc:299] Negotiation successful
0929 22:49:36.821152 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:49:36.821354 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:36.813326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39145 (local address 127.12.27.129:45099)
0929 22:49:36.813464 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:36.813497 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:36.813946 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:36.814143 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:36.814146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:36.814685 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:36.814884 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:36.814888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.815521 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.815522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:36.816359 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:36.816361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.816679 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.816680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:36.816852 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:36.817415 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:36.817423 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:36.818791 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:36.820185 (+ 1394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:36.820191 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:36.820193 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:36.820407 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:36.820572 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:36.820573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:36.820573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:36.820662 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:36.820879 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:36.820883 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:36.820985 (+ 102us) client_negotiation.cc:769] Sending connection context
0929 22:49:36.821063 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 22:49:36.821169 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260929 22:49:36.821856 30717 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39145
I20260929 22:49:36.821954 30717 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:36.822118 30717 heartbeater.cc:511] Master 127.12.27.190:39145 requested a full tablet report, sending...
I20260929 22:49:36.822400 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30587
I20260929 22:49:36.822525 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:49:36.822683 30525 ts_manager.cc:194] Registered new tserver with Master: 03cdb67c6ea84da79c62e74ae102f2bd (127.12.27.129:44765)
I20260929 22:49:36.822721 12398 external_mini_cluster.cc:1428] Setting key b8b40e177d49f5111290fb23ff733023
I20260929 22:49:36.823369 30525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:45099
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:49:36.847297 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39145
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:46719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:36.929016 30722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:36.929217 30722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:36.929240 30722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:36.930375 30722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:36.930418 30722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:36.930469 30722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:36.931919 30722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:46719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:36.932181 30722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:36.932427 30722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:36.937538 30730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:36.937551 30727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:36.937552 30728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:36.937650 30722 server_base.cc:1034] running on GCE node
I20260929 22:49:36.937952 30722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:36.938212 30722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:36.939373 30722 hybrid_clock.cc:648] HybridClock initialized: now 1790722176939370 us; error 36 us; skew 500 ppm
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:36.941876 30722 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:49:36.942282 30722 webserver.cc:460] Webserver started at http://127.12.27.130:42795/ using document root <none> and password file <none>
I20260929 22:49:36.942505 30722 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:36.942574 30722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:36.942727 30722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:36.943836 30722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "067c71913af84908abc360e1f1990264"
server_key_iv: "3fca5c71ab44cdf8e65d7a5fda3ca716"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.944191 30722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "067c71913af84908abc360e1f1990264"
server_key_iv: "3fca5c71ab44cdf8e65d7a5fda3ca716"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.945463 30722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:36.946161 30737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.946334 30722 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:36.946434 30722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64"
format_stamp: "Formatted at 2026-09-29 22:49:36 on dist-test-slave-00d6"
server_key: "067c71913af84908abc360e1f1990264"
server_key_iv: "3fca5c71ab44cdf8e65d7a5fda3ca716"
server_key_version: "encryptionkey@0"
I20260929 22:49:36.946513 30722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:36.954952 30722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:36.956832 30722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:36.956985 30722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:36.957195 30722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:36.957485 30722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:36.957544 30722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.957583 30722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:36.957610 30722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:36.963330 30722 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:39445
I20260929 22:49:36.963372 30850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:39445 every 8 connection(s)
I20260929 22:49:36.963725 30722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:49:36 dist-test-slave-00d6 krb5kdc[30480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:36.971884 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30722
I20260929 22:49:36.972015 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:49:36.972324 12398 external_mini_cluster.cc:1428] Setting key 2c565bbb10d2632281e94acbdbb3284e
I20260929 22:49:36.973398 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:36.964389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:53991 (local address 127.12.27.190:39145)
0929 22:49:36.964435 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:36.964437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:36.964607 (+ 170us) server_negotiation.cc:407] Connection header received
0929 22:49:36.965126 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:36.965127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:36.965138 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:36.965212 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:36.966171 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.966682 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.967813 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.968025 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.968116 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:36.970263 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:36.970264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:36.970264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:36.970271 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:36.971589 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:36.972160 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:36.972162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:36.972163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:36.972235 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:36.972628 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:36.972629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:36.972629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:36.972752 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:36.972940 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:36.973226 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 22:49:36.973310 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:49:36.973605 30853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:36.964341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39145 (local address 127.12.27.130:53991)
0929 22:49:36.964479 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:36.964525 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:36.965024 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:36.965284 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:36.965289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:36.965862 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:36.966054 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:36.966063 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.966783 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.966784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:36.967576 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:36.967578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:36.968129 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:36.968129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:36.968258 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:36.968755 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:36.968764 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:36.970158 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:36.971725 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:36.971732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:36.971735 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:36.972069 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:36.972311 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:36.972312 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:36.972312 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:36.972456 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:36.972932 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:36.972939 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:36.973081 (+ 142us) client_negotiation.cc:769] Sending connection context
0929 22:49:36.973196 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:49:36.973358 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
I20260929 22:49:36.974049 30851 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39145
I20260929 22:49:36.974135 30851 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:36.974340 30851 heartbeater.cc:511] Master 127.12.27.190:39145 requested a full tablet report, sending...
I20260929 22:49:36.974730 30525 ts_manager.cc:194] Registered new tserver with Master: 04e1dfbdc79b4f22b7c46b95ebac2f64 (127.12.27.130:39445)
I20260929 22:49:36.975122 30525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:53991
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:49:36.998231 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39145
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:46719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:37.078303 30856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:37.078557 30856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:37.078598 30856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:37.079757 30856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:37.079824 30856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:37.079869 30856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:37.081303 30856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:46719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:37.081560 30856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:37.081782 30856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:37.086809 30861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.086822 30862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.086982 30856 server_base.cc:1034] running on GCE node
W20260929 22:49:37.086824 30864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.087234 30856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:37.087436 30856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:37.088563 30856 hybrid_clock.cc:648] HybridClock initialized: now 1790722177088552 us; error 27 us; skew 500 ppm
Sep 29 22:49:37 dist-test-slave-00d6 krb5kdc[30480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722177, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:37.091027 30856 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:49:37.091471 30856 webserver.cc:460] Webserver started at http://127.12.27.131:39329/ using document root <none> and password file <none>
I20260929 22:49:37.091699 30856 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:37.091745 30856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:37.091833 30856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:37.092808 30856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "7de4b693f8eb4a2c886b357cf08ce1c3"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "f4f975b020d5ddc7bfa98361ec403dc3"
server_key_iv: "94cb07b39ac2384fc90750e7e067ab95"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.093099 30856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "7de4b693f8eb4a2c886b357cf08ce1c3"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "f4f975b020d5ddc7bfa98361ec403dc3"
server_key_iv: "94cb07b39ac2384fc90750e7e067ab95"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.094313 30856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 22:49:37.095024 30871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.095252 30856 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:37.095347 30856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "7de4b693f8eb4a2c886b357cf08ce1c3"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "f4f975b020d5ddc7bfa98361ec403dc3"
server_key_iv: "94cb07b39ac2384fc90750e7e067ab95"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.095443 30856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:37.112517 30856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:37.114887 30856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:37.115052 30856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:37.115290 30856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:37.115612 30856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:37.115710 30856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.115752 30856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:37.115778 30856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.121827 30856 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38449
I20260929 22:49:37.121872 30984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38449 every 8 connection(s)
I20260929 22:49:37.122179 30856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:49:37.123088 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 30856
I20260929 22:49:37.123215 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:49:37.123395 12398 external_mini_cluster.cc:1428] Setting key ded35f9a0afff7ed9583a94bc66a17e9
Sep 29 22:49:37 dist-test-slave-00d6 krb5kdc[30480](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722177, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:37.131827 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.122862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:60411 (local address 127.12.27.190:39145)
0929 22:49:37.122924 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.122926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.123184 (+ 258us) server_negotiation.cc:407] Connection header received
0929 22:49:37.123823 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.123823 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.123833 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.123919 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.125022 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.125666 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.126780 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.127036 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.127094 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.129288 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.129289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.129289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:37.129295 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.130689 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:37.131038 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:37.131038 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:37.131039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:37.131084 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:37.131286 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:37.131286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:37.131287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:37.131380 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.131428 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.131703 (+ 275us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.131766 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:49:37.132088 30987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.122856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:39145 (local address 127.12.27.131:60411)
0929 22:49:37.123026 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.123081 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.123723 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.123988 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.124001 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.124755 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:37.124943 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.124947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.125779 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.125780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.126691 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.126693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.127128 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.127129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.127312 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.127800 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:37.127808 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:37.129207 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:37.130763 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:37.130768 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:37.130770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:37.130972 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:37.131140 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:37.131141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:37.131141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:37.131232 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:37.131433 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:37.131437 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:37.131543 (+ 106us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.131666 (+ 123us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.131794 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":104,"threads_started":1}
I20260929 22:49:37.132542 30985 heartbeater.cc:347] Connected to a master server at 127.12.27.190:39145
I20260929 22:49:37.132632 30985 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:37.132766 30985 heartbeater.cc:511] Master 127.12.27.190:39145 requested a full tablet report, sending...
I20260929 22:49:37.133074 30525 ts_manager.cc:194] Registered new tserver with Master: 7de4b693f8eb4a2c886b357cf08ce1c3 (127.12.27.131:38449)
I20260929 22:49:37.133435 30525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:60411
I20260929 22:49:37.135234 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:49:37.142364 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.136610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48638 (local address 127.12.27.190:39145)
0929 22:49:37.136662 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.136664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.136785 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:49:37.136820 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.136821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.136829 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.136881 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.137375 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.137854 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.138564 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.138739 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.138791 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.140067 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.140068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.140069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:37.140074 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.141398 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:37.141750 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:37.141750 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:37.141751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:37.141805 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:37.141984 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:37.141985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:37.141985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:37.142094 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.142171 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.142263 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.142307 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 22:49:37.143849 30525 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:49:37.145422 30525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:49:37.151904 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.147793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:44765 (local address 127.0.0.1:33266)
0929 22:49:37.147996 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.148007 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.148047 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.148444 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.148445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.148447 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.148491 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.148493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.149527 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.149528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.150933 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.150935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.151589 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.151590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.151688 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.151706 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.151775 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.151829 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":106,"thread_start_us":65,"threads_started":1}
I20260929 22:49:37.151989 30996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.147568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:39445 (local address 127.0.0.1:56230)
0929 22:49:37.147884 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.147924 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.147997 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.148246 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.148250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.148252 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.148327 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.148329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.149639 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.149639 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.150840 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.150843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.151729 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.151730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.151799 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.151802 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.151852 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.151884 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":25,"thread_start_us":54,"threads_started":1}
I20260929 22:49:37.152130 30997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.147597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38449 (local address 127.0.0.1:46734)
0929 22:49:37.147982 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.147993 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.148056 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.148335 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.148336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.148338 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.148380 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.148382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.149645 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.149646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.150836 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.150838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.151817 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.151818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.151882 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.151886 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.151936 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.151975 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":49,"thread_start_us":88,"threads_started":1}
I20260929 22:49:37.152173 30998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.147703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46734 (local address 127.12.27.131:38449)
0929 22:49:37.147877 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.147884 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.148118 (+ 234us) server_negotiation.cc:407] Connection header received
0929 22:49:37.148161 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.148163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.148178 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.148245 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.148456 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.149523 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.150921 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.151599 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.151740 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.151790 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.152044 (+ 254us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.152097 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
I20260929 22:49:37.152318 31001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.148008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33266 (local address 127.12.27.129:44765)
0929 22:49:37.148179 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.148184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.148193 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:37.148230 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.148232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.148245 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.148346 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.148574 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.149428 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.150999 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.151484 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.151584 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.151663 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.152162 (+ 499us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.152218 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
I20260929 22:49:37.152885 30651 tablet_service.cc:1467] Processing CreateTablet for tablet da71abdbe81644cb9abd39e258bdc6bf (DEFAULT_TABLE table=test-table [id=76c7104b8d3646af8f2c56f73d35e743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:37.152885 30919 tablet_service.cc:1467] Processing CreateTablet for tablet da71abdbe81644cb9abd39e258bdc6bf (DEFAULT_TABLE table=test-table [id=76c7104b8d3646af8f2c56f73d35e743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:37.153239 30919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da71abdbe81644cb9abd39e258bdc6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.153240 30651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da71abdbe81644cb9abd39e258bdc6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.155702 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.147708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56230 (local address 127.12.27.130:39445)
0929 22:49:37.147929 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.147933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.148088 (+ 155us) server_negotiation.cc:407] Connection header received
0929 22:49:37.148135 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.148137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.148154 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.148243 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.148416 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.149542 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.150965 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.151655 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.151730 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.151784 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.151863 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.151905 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260929 22:49:37.156394 30785 tablet_service.cc:1467] Processing CreateTablet for tablet da71abdbe81644cb9abd39e258bdc6bf (DEFAULT_TABLE table=test-table [id=76c7104b8d3646af8f2c56f73d35e743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:37.156517 31002 tablet_bootstrap.cc:492] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Bootstrap starting.
I20260929 22:49:37.156730 30785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da71abdbe81644cb9abd39e258bdc6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.157172 31002 tablet_bootstrap.cc:654] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.157752 31002 log.cc:824] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.158079 31003 tablet_bootstrap.cc:492] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: Bootstrap starting.
I20260929 22:49:37.158722 31003 tablet_bootstrap.cc:654] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.159322 31003 log.cc:824] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.159899 31002 tablet_bootstrap.cc:492] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: No bootstrap required, opened a new log
I20260929 22:49:37.159960 31002 ts_tablet_manager.cc:1397] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260929 22:49:37.160266 31006 tablet_bootstrap.cc:492] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Bootstrap starting.
I20260929 22:49:37.160825 31006 tablet_bootstrap.cc:654] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.161252 31006 log.cc:824] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.161667 31002 raft_consensus.cc:348] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.161854 31002 raft_consensus.cc:374] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.161906 31002 raft_consensus.cc:729] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de4b693f8eb4a2c886b357cf08ce1c3, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.162029 31002 consensus_queue.cc:260] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.162061 31006 tablet_bootstrap.cc:492] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: No bootstrap required, opened a new log
I20260929 22:49:37.162106 31006 ts_tablet_manager.cc:1397] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:49:37.162322 31002 ts_tablet_manager.cc:1428] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:37.162345 30985 heartbeater.cc:503] Master 127.12.27.190:39145 was elected leader, sending a full tablet report...
I20260929 22:49:37.162715 31003 tablet_bootstrap.cc:492] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: No bootstrap required, opened a new log
I20260929 22:49:37.162791 31003 ts_tablet_manager.cc:1397] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260929 22:49:37.164067 31006 raft_consensus.cc:348] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.164222 31006 raft_consensus.cc:374] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.164268 31006 raft_consensus.cc:729] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e1dfbdc79b4f22b7c46b95ebac2f64, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.164376 31006 consensus_queue.cc:260] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.164654 31006 ts_tablet_manager.cc:1428] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:49:37.164693 30851 heartbeater.cc:503] Master 127.12.27.190:39145 was elected leader, sending a full tablet report...
I20260929 22:49:37.164566 31003 raft_consensus.cc:348] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.164743 31003 raft_consensus.cc:374] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.164777 31003 raft_consensus.cc:729] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdb67c6ea84da79c62e74ae102f2bd, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.164891 31003 consensus_queue.cc:260] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.165160 31003 ts_tablet_manager.cc:1428] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:49:37.165194 30717 heartbeater.cc:503] Master 127.12.27.190:39145 was elected leader, sending a full tablet report...
W20260929 22:49:37.214282 30852 tablet.cc:2369] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:49:37.313308 30718 tablet.cc:2369] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:49:37.317086 31009 raft_consensus.cc:482] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:37.317198 31009 raft_consensus.cc:504] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.317610 31009 leader_election.cc:288] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdb67c6ea84da79c62e74ae102f2bd (127.12.27.129:44765), 7de4b693f8eb4a2c886b357cf08ce1c3 (127.12.27.131:38449)
I20260929 22:49:37.321745 30998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.318068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:50047 (local address 127.12.27.131:38449)
0929 22:49:37.318120 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.318122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.318131 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:37.318185 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.318186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.318195 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.318249 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.318444 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.319204 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.320804 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.321372 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.321452 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.321460 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.321628 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.321675 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:49:37.321750 31011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.317815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38449 (local address 127.12.27.130:50047)
0929 22:49:37.318021 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.318068 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.318136 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.318259 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.318260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.318261 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.318340 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.318342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.319307 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.319308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.320710 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.320713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.321458 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.321459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.321548 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.321552 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.321611 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.321657 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":62,"thread_start_us":105,"threads_started":1}
I20260929 22:49:37.321807 31001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.318001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:53149 (local address 127.12.27.129:44765)
0929 22:49:37.318093 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.318095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.318110 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:49:37.318143 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.318144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.318155 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.318220 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.318442 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.319218 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.320803 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.321377 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.321452 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.321460 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.321696 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.321740 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260929 22:49:37.321921 30853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.317815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:44765 (local address 127.12.27.130:53149)
0929 22:49:37.317942 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.317954 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.318014 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.318238 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.318239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.318241 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.318341 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.318342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.319307 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.319308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.320710 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.320713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.321458 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.321459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.321566 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.321569 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.321619 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.321658 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":131}
I20260929 22:49:37.322253 30939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da71abdbe81644cb9abd39e258bdc6bf" candidate_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" is_pre_election: true
I20260929 22:49:37.322294 30671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da71abdbe81644cb9abd39e258bdc6bf" candidate_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" is_pre_election: true
I20260929 22:49:37.322378 30939 raft_consensus.cc:2454] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1dfbdc79b4f22b7c46b95ebac2f64 in term 0.
I20260929 22:49:37.322484 30671 raft_consensus.cc:2454] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1dfbdc79b4f22b7c46b95ebac2f64 in term 0.
I20260929 22:49:37.322645 30741 leader_election.cc:302] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1dfbdc79b4f22b7c46b95ebac2f64, 7de4b693f8eb4a2c886b357cf08ce1c3; no voters:
I20260929 22:49:37.322788 31009 raft_consensus.cc:2781] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:49:37.322844 31009 raft_consensus.cc:482] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:49:37.322873 31009 raft_consensus.cc:3037] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:37.323534 31009 raft_consensus.cc:504] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.323689 31009 leader_election.cc:288] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdb67c6ea84da79c62e74ae102f2bd (127.12.27.129:44765), 7de4b693f8eb4a2c886b357cf08ce1c3 (127.12.27.131:38449)
I20260929 22:49:37.323822 30671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da71abdbe81644cb9abd39e258bdc6bf" candidate_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdb67c6ea84da79c62e74ae102f2bd"
I20260929 22:49:37.323861 30939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da71abdbe81644cb9abd39e258bdc6bf" candidate_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3"
I20260929 22:49:37.323904 30671 raft_consensus.cc:3037] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:37.323946 30939 raft_consensus.cc:3037] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:37.324605 30671 raft_consensus.cc:2454] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1dfbdc79b4f22b7c46b95ebac2f64 in term 1.
I20260929 22:49:37.324733 30939 raft_consensus.cc:2454] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1dfbdc79b4f22b7c46b95ebac2f64 in term 1.
I20260929 22:49:37.324821 30739 leader_election.cc:302] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdb67c6ea84da79c62e74ae102f2bd, 04e1dfbdc79b4f22b7c46b95ebac2f64; no voters:
I20260929 22:49:37.324913 31009 raft_consensus.cc:2781] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:37.325099 31009 raft_consensus.cc:686] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 1 LEADER]: Becoming Leader. State: Replica: 04e1dfbdc79b4f22b7c46b95ebac2f64, State: Running, Role: LEADER
I20260929 22:49:37.325223 31009 consensus_queue.cc:237] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } }
I20260929 22:49:37.326141 30525 catalog_manager.cc:5495] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e1dfbdc79b4f22b7c46b95ebac2f64 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1dfbdc79b4f22b7c46b95ebac2f64" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 39445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260929 22:49:37.331432 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.329430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56244 (local address 127.12.27.130:39445)
0929 22:49:37.329469 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.329471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.329480 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:37.329546 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.329547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.329561 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.329612 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:49:37.329724 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.330156 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.330852 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.331020 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.331068 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.331184 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:49:37.331260 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:49:37.331329 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.331376 (+ 47us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.331385 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:49:37.333038 30671 raft_consensus.cc:1261] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd [term 1 FOLLOWER]: Refusing update from remote peer 04e1dfbdc79b4f22b7c46b95ebac2f64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:37.333038 30939 raft_consensus.cc:1261] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 1 FOLLOWER]: Refusing update from remote peer 04e1dfbdc79b4f22b7c46b95ebac2f64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:37.333321 31009 consensus_queue.cc:1035] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdb67c6ea84da79c62e74ae102f2bd" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 44765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:37.333470 31012 consensus_queue.cc:1035] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de4b693f8eb4a2c886b357cf08ce1c3" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:37.335969 31016 mvcc.cc:205] Tried to move back new op lower bound from 7334798038353821696 to 7334798038324781056. Current Snapshot: MvccSnapshot[applied={T|T < 7334798038353821696}]
I20260929 22:49:37.338102 30525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:37.338210 30525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:37.338900 30525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6373b1a28721488c91bd65dc7d8aa7a4: Sending DeleteTablet for 3 replicas of tablet da71abdbe81644cb9abd39e258bdc6bf
I20260929 22:49:37.339179 30785 tablet_service.cc:1514] Processing DeleteTablet for tablet da71abdbe81644cb9abd39e258bdc6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:37 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:56230
I20260929 22:49:37.339218 30651 tablet_service.cc:1514] Processing DeleteTablet for tablet da71abdbe81644cb9abd39e258bdc6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:37 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:33266
I20260929 22:49:37.339262 30919 tablet_service.cc:1514] Processing DeleteTablet for tablet da71abdbe81644cb9abd39e258bdc6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:37 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:46734
I20260929 22:49:37.339469 31025 tablet_replica.cc:330] T da71abdbe81644cb9abd39e258bdc6bf P 03cdb67c6ea84da79c62e74ae102f2bd: stopping tablet replica
I20260929 22:49:37.339589 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30587
I20260929 22:49:37.341041 31026 tablet_replica.cc:330] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: stopping tablet replica
I20260929 22:49:37.341120 31026 raft_consensus.cc:2229] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:49:37.341259 31026 raft_consensus.cc:2258] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:37.341463 31027 tablet_replica.cc:330] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: stopping tablet replica
I20260929 22:49:37.341562 31027 raft_consensus.cc:2229] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:37.341660 31027 raft_consensus.cc:2258] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:37.341841 31026 ts_tablet_manager.cc:1905] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:37.342020 31027 ts_tablet_manager.cc:1905] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:37.343494 31026 ts_tablet_manager.cc:1918] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:37.343544 31027 ts_tablet_manager.cc:1918] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:37.343600 31027 log.cc:1196] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/da71abdbe81644cb9abd39e258bdc6bf
I20260929 22:49:37.343724 31026 log.cc:1196] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/da71abdbe81644cb9abd39e258bdc6bf
I20260929 22:49:37.343888 31027 ts_tablet_manager.cc:1939] T da71abdbe81644cb9abd39e258bdc6bf P 7de4b693f8eb4a2c886b357cf08ce1c3: Deleting consensus metadata
I20260929 22:49:37.344187 31026 ts_tablet_manager.cc:1939] T da71abdbe81644cb9abd39e258bdc6bf P 04e1dfbdc79b4f22b7c46b95ebac2f64: Deleting consensus metadata
I20260929 22:49:37.344295 30512 catalog_manager.cc:4841] TS 7de4b693f8eb4a2c886b357cf08ce1c3 (127.12.27.131:38449): tablet da71abdbe81644cb9abd39e258bdc6bf (table test-table [id=76c7104b8d3646af8f2c56f73d35e743]) successfully deleted
I20260929 22:49:37.344538 30510 catalog_manager.cc:4841] TS 04e1dfbdc79b4f22b7c46b95ebac2f64 (127.12.27.130:39445): tablet da71abdbe81644cb9abd39e258bdc6bf (table test-table [id=76c7104b8d3646af8f2c56f73d35e743]) successfully deleted
W20260929 22:49:37.345755 30510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:44765 (error 108)
I20260929 22:49:37.345889 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30722
I20260929 22:49:37.346894 30997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.346739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:44765 (local address 127.0.0.1:33276)
0929 22:49:37.346810 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.346859 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:44765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260929 22:49:37.347014 30510 catalog_manager.cc:4584] TS 03cdb67c6ea84da79c62e74ae102f2bd (127.12.27.129:44765): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet da71abdbe81644cb9abd39e258bdc6bf: Network error: Client connection negotiation failed: client connection to 127.12.27.129:44765: connect: Connection refused (error 111)
I20260929 22:49:37.351294 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30856
I20260929 22:49:37.355741 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 30493
2026-09-29T22:49:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2013 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-29T22:49:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:37Z Disabled control of system clock
I20260929 22:49:37.382856 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:36565
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:37285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:36565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:37.461556 31032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:37.461768 31032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:37.461788 31032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:37.462857 31032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:37.462891 31032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:37.462903 31032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:37.462916 31032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:37.462929 31032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:37.464192 31032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:36565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:36565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:37.464372 31032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:37.464582 31032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:37.469277 31037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.469422 31032 server_base.cc:1034] running on GCE node
W20260929 22:49:37.469255 31040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.469235 31038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.469815 31032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:37.470121 31032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:37.471292 31032 hybrid_clock.cc:648] HybridClock initialized: now 1790722177471283 us; error 53 us; skew 500 ppm
I20260929 22:49:37.472515 31032 webserver.cc:460] Webserver started at http://127.12.27.190:41021/ using document root <none> and password file <none>
I20260929 22:49:37.472754 31032 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:37.472836 31032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:37.472983 31032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:37.474009 31032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "0267d37abb014bf39c042cfa596fdf94"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "29bfce2640e15f9c55d13fd5320838e6"
server_key_iv: "b856c4a18712824d47270d5f1363def6"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.474366 31032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "0267d37abb014bf39c042cfa596fdf94"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "29bfce2640e15f9c55d13fd5320838e6"
server_key_iv: "b856c4a18712824d47270d5f1363def6"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.475823 31032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:37.476558 31046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.476738 31032 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:37.476843 31032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "0267d37abb014bf39c042cfa596fdf94"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "29bfce2640e15f9c55d13fd5320838e6"
server_key_iv: "b856c4a18712824d47270d5f1363def6"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.476923 31032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:37.488343 31032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:37.488632 31032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:37.488786 31032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:37.492735 31032 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:36565
I20260929 22:49:37.492782 31098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:36565 every 8 connection(s)
I20260929 22:49:37.493100 31032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:37.494022 31099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.496244 31099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: Bootstrap starting.
I20260929 22:49:37.496758 31099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.496992 31099 log.cc:824] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.497051 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31032
I20260929 22:49:37.497152 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:37.497367 12398 external_mini_cluster.cc:1428] Setting key 0395e40c6acb75b67ffb15ff182212cc
I20260929 22:49:37.497749 31099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: No bootstrap required, opened a new log
I20260929 22:49:37.500519 31099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0267d37abb014bf39c042cfa596fdf94" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36565 } }
I20260929 22:49:37.500684 31099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.500723 31099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0267d37abb014bf39c042cfa596fdf94, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.500831 31099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0267d37abb014bf39c042cfa596fdf94" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36565 } }
I20260929 22:49:37.500895 31099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:37.500922 31099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:37.500959 31099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:37.501484 31099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0267d37abb014bf39c042cfa596fdf94" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36565 } }
I20260929 22:49:37.501569 31099 leader_election.cc:302] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0267d37abb014bf39c042cfa596fdf94; no voters:
I20260929 22:49:37.501768 31099 leader_election.cc:288] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:37.501794 31104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:37.501971 31104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [term 1 LEADER]: Becoming Leader. State: Replica: 0267d37abb014bf39c042cfa596fdf94, State: Running, Role: LEADER
I20260929 22:49:37.502089 31099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:37.502092 31104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0267d37abb014bf39c042cfa596fdf94" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36565 } }
I20260929 22:49:37.502511 31105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0267d37abb014bf39c042cfa596fdf94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0267d37abb014bf39c042cfa596fdf94" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36565 } } }
I20260929 22:49:37.502635 31105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:37.502528 31106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0267d37abb014bf39c042cfa596fdf94. Latest consensus state: current_term: 1 leader_uuid: "0267d37abb014bf39c042cfa596fdf94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0267d37abb014bf39c042cfa596fdf94" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 36565 } } }
I20260929 22:49:37.502782 31106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94 [sys.catalog]: This master's current role is: LEADER
W20260929 22:49:37.504029 31120 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:49:37.504103 31120 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:49:37.504190 31112 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:37.504333 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.497886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45240 (local address 127.12.27.190:36565)
0929 22:49:37.498100 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.498109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.498146 (+ 37us) server_negotiation.cc:407] Connection header received
0929 22:49:37.499029 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.499038 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.499114 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.499274 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.499475 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.500951 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.501866 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.502482 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.502604 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.503500 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.503504 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.503505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:37.503728 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.503771 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:37.503788 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.503850 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.503950 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.504028 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260929 22:49:37.504407 31112 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:37.505865 31112 catalog_manager.cc:1347] Generated new cluster ID: 01ff63651c5e41c1aec8ac5a0788b4b6
I20260929 22:49:37.505914 31112 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:37.513913 31112 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:37.514586 31112 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:37.525115 31112 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: Generated new TSK 0
I20260929 22:49:37.525303 31112 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:37.531315 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36565
--builtin_ntp_servers=127.12.27.148:37285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:37.613046 31123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:37.613240 31123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:37.613262 31123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:37.614413 31123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:37.614450 31123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:37.614475 31123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:37.615934 31123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:37.616170 31123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:37.616478 31123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:37.621733 31131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.621670 31129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.621680 31128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.622016 31123 server_base.cc:1034] running on GCE node
I20260929 22:49:37.622365 31123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:37.622609 31123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:37.623792 31123 hybrid_clock.cc:648] HybridClock initialized: now 1790722177623776 us; error 33 us; skew 500 ppm
I20260929 22:49:37.625074 31123 webserver.cc:460] Webserver started at http://127.12.27.129:44057/ using document root <none> and password file <none>
I20260929 22:49:37.625325 31123 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:37.625394 31123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:37.625532 31123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:37.626591 31123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "dfbfec7b9084457baf0ea661a1591761"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "dd2b2b6bfadab37dd91375483eb2ddc7"
server_key_iv: "1327c701b7c27718b385e8853ea76409"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.626950 31123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "dfbfec7b9084457baf0ea661a1591761"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "dd2b2b6bfadab37dd91375483eb2ddc7"
server_key_iv: "1327c701b7c27718b385e8853ea76409"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.628319 31123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:49:37.629024 31137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.629196 31123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:37.629282 31123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "dfbfec7b9084457baf0ea661a1591761"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "dd2b2b6bfadab37dd91375483eb2ddc7"
server_key_iv: "1327c701b7c27718b385e8853ea76409"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.629341 31123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:37.642428 31123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:37.642688 31123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:37.642798 31123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:37.642979 31123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:37.643263 31123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:37.643296 31123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.643321 31123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:37.643333 31123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.649286 31123 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:45011
I20260929 22:49:37.649372 31250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:45011 every 8 connection(s)
I20260929 22:49:37.649701 31123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:49:37.655045 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.650498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:34651 (local address 127.12.27.190:36565)
0929 22:49:37.650543 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.650545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.650788 (+ 243us) server_negotiation.cc:407] Connection header received
0929 22:49:37.651312 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.651314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.651331 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.651386 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.652094 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.652607 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.653605 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.653811 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.653884 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.654741 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.654743 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.654743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:37.654747 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.654763 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:37.654775 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.654842 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.654943 (+ 101us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.654968 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:49:37.655263 31253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.650465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36565 (local address 127.12.27.129:34651)
0929 22:49:37.650646 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.650682 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.651197 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.651451 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.651455 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.651464 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:37.651973 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.651978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.652708 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.652709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.653497 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.653499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.653904 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.653905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.654040 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.654591 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:37.654592 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:37.654619 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:37.654641 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:37.654843 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:37.654849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:37.654852 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.654945 (+ 93us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.655042 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260929 22:49:37.655810 31251 heartbeater.cc:347] Connected to a master server at 127.12.27.190:36565
I20260929 22:49:37.655910 31251 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:37.656091 31251 heartbeater.cc:511] Master 127.12.27.190:36565 requested a full tablet report, sending...
I20260929 22:49:37.656106 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31123
I20260929 22:49:37.656229 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:49:37.656472 12398 external_mini_cluster.cc:1428] Setting key f7010141d0f09957f3395f621498f7ed
I20260929 22:49:37.656610 31063 ts_manager.cc:194] Registered new tserver with Master: dfbfec7b9084457baf0ea661a1591761 (127.12.27.129:45011)
I20260929 22:49:37.657454 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36565
--builtin_ntp_servers=127.12.27.148:37285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:49:37.657459 31063 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.129:34651
W20260929 22:49:37.738588 31254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:37.738790 31254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:37.738813 31254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:37.740036 31254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:37.740077 31254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:37.740101 31254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:37.741413 31254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:37.741657 31254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:37.741950 31254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:37.746820 31259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.746838 31260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.746840 31262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.747134 31254 server_base.cc:1034] running on GCE node
I20260929 22:49:37.747349 31254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:37.747577 31254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:37.748726 31254 hybrid_clock.cc:648] HybridClock initialized: now 1790722177748710 us; error 40 us; skew 500 ppm
I20260929 22:49:37.749953 31254 webserver.cc:460] Webserver started at http://127.12.27.130:45139/ using document root <none> and password file <none>
I20260929 22:49:37.750183 31254 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:37.750232 31254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:37.750399 31254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:37.751471 31254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "b4ddaffd8c574cf5bb021db6b9086429"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "a298243d02de00a1e71a144932665aa0"
server_key_iv: "d3a12cef6d2c3c2c5f12406541120b8e"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.751927 31254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "b4ddaffd8c574cf5bb021db6b9086429"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "a298243d02de00a1e71a144932665aa0"
server_key_iv: "d3a12cef6d2c3c2c5f12406541120b8e"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.753496 31254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:37.754272 31268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.754464 31254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:37.754558 31254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "b4ddaffd8c574cf5bb021db6b9086429"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "a298243d02de00a1e71a144932665aa0"
server_key_iv: "d3a12cef6d2c3c2c5f12406541120b8e"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.754738 31254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:37.764816 31254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:37.765085 31254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:37.765235 31254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:37.765446 31254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:37.765754 31254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:37.765808 31254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.765847 31254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:37.765874 31254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.771950 31254 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:37849
I20260929 22:49:37.772003 31381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:37849 every 8 connection(s)
I20260929 22:49:37.772351 31254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:49:37.773231 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31254
I20260929 22:49:37.773371 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:49:37.773578 12398 external_mini_cluster.cc:1428] Setting key 88b20e1728f42a8bcd303e63184c708a
I20260929 22:49:37.774479 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36565
--builtin_ntp_servers=127.12.27.148:37285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:49:37.778205 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.773131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:35957 (local address 127.12.27.190:36565)
0929 22:49:37.773203 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.773205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.773385 (+ 180us) server_negotiation.cc:407] Connection header received
0929 22:49:37.773972 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.773973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.773986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.774037 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.774800 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.775329 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.776783 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.776971 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.777033 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.777919 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.777921 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.777921 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:37.777925 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.777938 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:37.777942 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.778022 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.778122 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.778145 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:49:37.778534 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.773081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36565 (local address 127.12.27.130:35957)
0929 22:49:37.773274 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.773313 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.773870 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.774118 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.774122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.774139 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:37.774696 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.774702 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.775430 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.775431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.776694 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.776697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.777068 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.777069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.777237 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.777768 (+ 531us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:37.777768 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:37.777807 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:37.777834 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:37.778034 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:37.778041 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:37.778044 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.778120 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.778269 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260929 22:49:37.779006 31382 heartbeater.cc:347] Connected to a master server at 127.12.27.190:36565
I20260929 22:49:37.779117 31382 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:37.779299 31382 heartbeater.cc:511] Master 127.12.27.190:36565 requested a full tablet report, sending...
I20260929 22:49:37.779697 31063 ts_manager.cc:194] Registered new tserver with Master: b4ddaffd8c574cf5bb021db6b9086429 (127.12.27.130:37849)
I20260929 22:49:37.780113 31063 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.130:35957
W20260929 22:49:37.855085 31385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:37.855322 31385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:37.855357 31385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:37.856509 31385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:37.856587 31385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:37.856629 31385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:37.858053 31385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:37.858330 31385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:37.858630 31385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:37.863577 31393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.863564 31390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:37.863554 31391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:37.863610 31385 server_base.cc:1034] running on GCE node
I20260929 22:49:37.863937 31385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:37.864125 31385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:37.865257 31385 hybrid_clock.cc:648] HybridClock initialized: now 1790722177865247 us; error 26 us; skew 500 ppm
I20260929 22:49:37.866432 31385 webserver.cc:460] Webserver started at http://127.12.27.131:44541/ using document root <none> and password file <none>
I20260929 22:49:37.866632 31385 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:37.866693 31385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:37.866787 31385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:37.867836 31385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "098ee61e5bc0428e940bfdf21bf2f36f"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "9647fe949dd5efb0f58f6f32571b2787"
server_key_iv: "a0d5cb3796faac955b84f0fd1b68e751"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.868134 31385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "098ee61e5bc0428e940bfdf21bf2f36f"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "9647fe949dd5efb0f58f6f32571b2787"
server_key_iv: "a0d5cb3796faac955b84f0fd1b68e751"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.869338 31385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:37.870036 31399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.870208 31385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:37.870292 31385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "098ee61e5bc0428e940bfdf21bf2f36f"
format_stamp: "Formatted at 2026-09-29 22:49:37 on dist-test-slave-00d6"
server_key: "9647fe949dd5efb0f58f6f32571b2787"
server_key_iv: "a0d5cb3796faac955b84f0fd1b68e751"
server_key_version: "encryptionkey@0"
I20260929 22:49:37.870344 31385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:37.877297 31385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:37.877511 31385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:37.877606 31385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:37.877768 31385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:37.878000 31385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:37.878026 31385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.878046 31385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:37.878063 31385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:37.883457 31385 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:38419
I20260929 22:49:37.883530 31512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:38419 every 8 connection(s)
I20260929 22:49:37.883876 31385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:49:37.889214 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.884592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:47687 (local address 127.12.27.190:36565)
0929 22:49:37.884716 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.884719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.884898 (+ 179us) server_negotiation.cc:407] Connection header received
0929 22:49:37.885416 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.885417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.885430 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.885477 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.886143 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.886651 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.887907 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.888120 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.888194 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.888944 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.888946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.888946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:37.888951 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.888967 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:37.888971 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.889014 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.889111 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.889137 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 22:49:37.889447 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.884570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:36565 (local address 127.12.27.131:47687)
0929 22:49:37.884787 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.884819 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.885305 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.885557 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.885560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.885568 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:37.886043 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.886047 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.886746 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.886747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.887814 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.887816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.888211 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.888212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.888351 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.888811 (+ 460us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:37.888812 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:37.888837 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:37.888857 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:37.889026 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:37.889030 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:37.889033 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.889114 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.889207 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260929 22:49:37.889698 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31385
I20260929 22:49:37.889815 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:49:37.889936 31513 heartbeater.cc:347] Connected to a master server at 127.12.27.190:36565
I20260929 22:49:37.890012 31513 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:37.890022 12398 external_mini_cluster.cc:1428] Setting key bc6dd4beb7ffc59adfa545187d310dad
I20260929 22:49:37.890196 31513 heartbeater.cc:511] Master 127.12.27.190:36565 requested a full tablet report, sending...
I20260929 22:49:37.890525 31063 ts_manager.cc:194] Registered new tserver with Master: 098ee61e5bc0428e940bfdf21bf2f36f (127.12.27.131:38419)
I20260929 22:49:37.890952 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:49:37.890962 31063 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.131:47687
I20260929 22:49:37.894903 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.892417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45250 (local address 127.12.27.190:36565)
0929 22:49:37.892470 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.892472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.892593 (+ 121us) server_negotiation.cc:407] Connection header received
0929 22:49:37.892638 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.892638 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.892645 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.892706 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:37.892823 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.893251 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.893943 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.894108 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.894154 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.894705 (+ 551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:37.894706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:37.894707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:37.894710 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:37.894721 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:37.894724 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:37.894791 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.894849 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.894857 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 22:49:37.896314 31063 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:49:37.897801 31063 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:49:37.904032 31522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.899769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37849 (local address 127.0.0.1:50236)
0929 22:49:37.900009 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.900020 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.900073 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.900607 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.900608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.900610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.900654 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.900655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.901533 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.901534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.902654 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.902656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.903726 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.903727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.903803 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.903816 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.903901 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.903960 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":88,"threads_started":1}
I20260929 22:49:37.904060 31526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.900016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50236 (local address 127.12.27.130:37849)
0929 22:49:37.900434 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.900438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.900448 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:37.900485 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.900487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.900501 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.900594 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.900726 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.901396 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.902761 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.903600 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.903722 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.903813 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.903915 (+ 102us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.903954 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":100,"threads_started":1}
I20260929 22:49:37.904186 31524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.899780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45011 (local address 127.0.0.1:38050)
0929 22:49:37.900154 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.900162 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.900197 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.900615 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.900616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.900618 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.900661 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.900664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.901983 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.901984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.903015 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.903017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.903975 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.903976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.904032 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.904035 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.904065 (+ 30us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.904103 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":46,"thread_start_us":84,"threads_started":1}
I20260929 22:49:37.904284 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.899751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38419 (local address 127.0.0.1:46902)
0929 22:49:37.899843 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:37.899876 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:37.899934 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:37.900337 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:37.900340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:37.900343 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:37.900407 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.900409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.902016 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.902017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.903141 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:37.903144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.904046 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.904048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:37.904114 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.904119 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:49:37.904149 (+ 30us) client_negotiation.cc:240] Negotiation successful
0929 22:49:37.904186 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":16,"thread_start_us":53,"threads_started":1}
I20260929 22:49:37.904630 31527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.900227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38050 (local address 127.12.27.129:45011)
0929 22:49:37.900444 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.900449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.900459 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:37.900501 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.900502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.900519 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.900738 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.900804 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.901892 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.903094 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.903887 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.904389 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.904480 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.904505 (+ 25us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.904540 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260929 22:49:37.904675 31525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:37.900005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.12.27.131:38419)
0929 22:49:37.900159 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:37.900163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:37.900173 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:37.900208 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:37.900210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:37.900225 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:37.900307 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:37.900690 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.901920 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.903245 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:37.903954 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:37.904441 (+ 487us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:37.904539 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:37.904562 (+ 23us) server_negotiation.cc:299] Negotiation successful
0929 22:49:37.904596 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260929 22:49:37.905037 31316 tablet_service.cc:1467] Processing CreateTablet for tablet eef7f67506404f488321a7c91dc07063 (DEFAULT_TABLE table=test-table [id=ead003bf11af4c669771742bf487b9b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:37.905264 31447 tablet_service.cc:1467] Processing CreateTablet for tablet eef7f67506404f488321a7c91dc07063 (DEFAULT_TABLE table=test-table [id=ead003bf11af4c669771742bf487b9b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:37.905400 31316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eef7f67506404f488321a7c91dc07063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.905541 31447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eef7f67506404f488321a7c91dc07063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.908237 31185 tablet_service.cc:1467] Processing CreateTablet for tablet eef7f67506404f488321a7c91dc07063 (DEFAULT_TABLE table=test-table [id=ead003bf11af4c669771742bf487b9b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:37.908589 31185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eef7f67506404f488321a7c91dc07063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:37.908860 31529 tablet_bootstrap.cc:492] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Bootstrap starting.
I20260929 22:49:37.909512 31529 tablet_bootstrap.cc:654] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.909857 31529 log.cc:824] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.910205 31528 tablet_bootstrap.cc:492] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Bootstrap starting.
I20260929 22:49:37.910547 31529 tablet_bootstrap.cc:492] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: No bootstrap required, opened a new log
I20260929 22:49:37.910626 31529 ts_tablet_manager.cc:1397] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:49:37.910815 31528 tablet_bootstrap.cc:654] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.911131 31528 log.cc:824] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.912179 31528 tablet_bootstrap.cc:492] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: No bootstrap required, opened a new log
I20260929 22:49:37.912242 31528 ts_tablet_manager.cc:1397] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:37.912984 31529 raft_consensus.cc:348] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:37.913134 31529 raft_consensus.cc:374] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.913178 31529 raft_consensus.cc:729] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 098ee61e5bc0428e940bfdf21bf2f36f, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.913291 31529 consensus_queue.cc:260] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:37.913575 31529 ts_tablet_manager.cc:1428] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:49:37.913590 31513 heartbeater.cc:503] Master 127.12.27.190:36565 was elected leader, sending a full tablet report...
I20260929 22:49:37.914358 31528 raft_consensus.cc:348] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:37.914546 31528 raft_consensus.cc:374] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.914580 31528 raft_consensus.cc:729] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4ddaffd8c574cf5bb021db6b9086429, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.914685 31528 consensus_queue.cc:260] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:37.914963 31382 heartbeater.cc:503] Master 127.12.27.190:36565 was elected leader, sending a full tablet report...
I20260929 22:49:37.915129 31528 ts_tablet_manager.cc:1428] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 22:49:37.915330 31532 tablet_bootstrap.cc:492] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761: Bootstrap starting.
I20260929 22:49:37.915978 31532 tablet_bootstrap.cc:654] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:37.916334 31532 log.cc:824] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:37.916949 31532 tablet_bootstrap.cc:492] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761: No bootstrap required, opened a new log
I20260929 22:49:37.916999 31532 ts_tablet_manager.cc:1397] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:49:37.918635 31532 raft_consensus.cc:348] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:37.918752 31532 raft_consensus.cc:374] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:37.918781 31532 raft_consensus.cc:729] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfbfec7b9084457baf0ea661a1591761, State: Initialized, Role: FOLLOWER
I20260929 22:49:37.918859 31532 consensus_queue.cc:260] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:37.919128 31532 ts_tablet_manager.cc:1428] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:49:37.919166 31251 heartbeater.cc:503] Master 127.12.27.190:36565 was elected leader, sending a full tablet report...
I20260929 22:49:38.009466 31534 raft_consensus.cc:482] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:38.009603 31534 raft_consensus.cc:504] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:38.010027 31534 leader_election.cc:288] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 098ee61e5bc0428e940bfdf21bf2f36f (127.12.27.131:38419), dfbfec7b9084457baf0ea661a1591761 (127.12.27.129:45011)
I20260929 22:49:38.013010 31537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:38.010230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:38419 (local address 127.12.27.130:33611)
0929 22:49:38.010426 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:38.010435 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:38.010487 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:38.010627 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:38.010628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:38.010630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:38.010710 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:38.010711 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.011389 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.011390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:38.012218 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:38.012220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.012752 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.012753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:38.012828 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:38.012831 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:38.012873 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 22:49:38.012903 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":15,"thread_start_us":106,"threads_started":1}
I20260929 22:49:38.013024 31525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:38.010312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:33611 (local address 127.12.27.131:38419)
0929 22:49:38.010369 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:38.010371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:38.010523 (+ 152us) server_negotiation.cc:407] Connection header received
0929 22:49:38.010553 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:38.010554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:38.010562 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:38.010610 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:38.010835 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.011319 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.012310 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.012672 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.012730 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:38.012760 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:38.012897 (+ 137us) server_negotiation.cc:299] Negotiation successful
0929 22:49:38.012947 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:49:38.013065 31527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:38.010306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:45519 (local address 127.12.27.129:45011)
0929 22:49:38.010354 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:38.010356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:38.010369 (+ 13us) server_negotiation.cc:407] Connection header received
0929 22:49:38.010438 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:38.010439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:38.010448 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:38.010536 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:38.010744 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.011240 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.012316 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.012680 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.012770 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:38.012777 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:38.012946 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 22:49:38.012990 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:49:38.013099 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:38.010230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45011 (local address 127.12.27.130:45519)
0929 22:49:38.010308 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:38.010321 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:38.010374 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:38.010562 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:38.010562 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:38.010564 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:38.010656 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:38.010658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.011324 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.011326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:38.012216 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:38.012219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.012797 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.012798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:38.012851 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:38.012853 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:49:38.012930 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:49:38.012965 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":39}
I20260929 22:49:38.013571 31467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eef7f67506404f488321a7c91dc07063" candidate_uuid: "b4ddaffd8c574cf5bb021db6b9086429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" is_pre_election: true
I20260929 22:49:38.013582 31205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eef7f67506404f488321a7c91dc07063" candidate_uuid: "b4ddaffd8c574cf5bb021db6b9086429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbfec7b9084457baf0ea661a1591761" is_pre_election: true
I20260929 22:49:38.013727 31205 raft_consensus.cc:2454] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4ddaffd8c574cf5bb021db6b9086429 in term 0.
I20260929 22:49:38.013729 31467 raft_consensus.cc:2454] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4ddaffd8c574cf5bb021db6b9086429 in term 0.
I20260929 22:49:38.013945 31270 leader_election.cc:302] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4ddaffd8c574cf5bb021db6b9086429, dfbfec7b9084457baf0ea661a1591761; no voters:
I20260929 22:49:38.014074 31534 raft_consensus.cc:2781] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:49:38.014127 31534 raft_consensus.cc:482] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:49:38.014161 31534 raft_consensus.cc:3037] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:38.014848 31534 raft_consensus.cc:504] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:38.015089 31534 leader_election.cc:288] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [CANDIDATE]: Term 1 election: Requested vote from peers 098ee61e5bc0428e940bfdf21bf2f36f (127.12.27.131:38419), dfbfec7b9084457baf0ea661a1591761 (127.12.27.129:45011)
I20260929 22:49:38.015234 31205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eef7f67506404f488321a7c91dc07063" candidate_uuid: "b4ddaffd8c574cf5bb021db6b9086429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfbfec7b9084457baf0ea661a1591761"
I20260929 22:49:38.015230 31467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eef7f67506404f488321a7c91dc07063" candidate_uuid: "b4ddaffd8c574cf5bb021db6b9086429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "098ee61e5bc0428e940bfdf21bf2f36f"
I20260929 22:49:38.015329 31467 raft_consensus.cc:3037] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:38.015317 31205 raft_consensus.cc:3037] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:38.016124 31467 raft_consensus.cc:2454] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4ddaffd8c574cf5bb021db6b9086429 in term 1.
I20260929 22:49:38.016197 31205 raft_consensus.cc:2454] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4ddaffd8c574cf5bb021db6b9086429 in term 1.
I20260929 22:49:38.016306 31271 leader_election.cc:302] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 098ee61e5bc0428e940bfdf21bf2f36f, b4ddaffd8c574cf5bb021db6b9086429; no voters:
I20260929 22:49:38.016402 31534 raft_consensus.cc:2781] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:38.016561 31534 raft_consensus.cc:686] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 1 LEADER]: Becoming Leader. State: Replica: b4ddaffd8c574cf5bb021db6b9086429, State: Running, Role: LEADER
I20260929 22:49:38.016664 31534 consensus_queue.cc:237] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } }
I20260929 22:49:38.017529 31063 catalog_manager.cc:5495] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4ddaffd8c574cf5bb021db6b9086429 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "b4ddaffd8c574cf5bb021db6b9086429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4ddaffd8c574cf5bb021db6b9086429" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 } health_report { overall_health: UNKNOWN } } }
W20260929 22:49:38.022871 31383 tablet.cc:2369] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:49:38.048794 31526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:38.046569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50252 (local address 127.12.27.130:37849)
0929 22:49:38.046637 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:38.046639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:38.046650 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:38.046688 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:38.046689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:38.046708 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:38.046792 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:49:38.046895 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.047349 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.048052 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:38.048228 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:38.048280 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:38.048407 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:49:38.048490 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:49:38.048559 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:38.048648 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 22:49:38.048658 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:49:38.050529 31205 raft_consensus.cc:1261] T eef7f67506404f488321a7c91dc07063 P dfbfec7b9084457baf0ea661a1591761 [term 1 FOLLOWER]: Refusing update from remote peer b4ddaffd8c574cf5bb021db6b9086429: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:38.050558 31467 raft_consensus.cc:1261] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 1 FOLLOWER]: Refusing update from remote peer b4ddaffd8c574cf5bb021db6b9086429: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:38.050861 31534 consensus_queue.cc:1035] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "098ee61e5bc0428e940bfdf21bf2f36f" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:38.050992 31538 consensus_queue.cc:1035] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfbfec7b9084457baf0ea661a1591761" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 45011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:38.053359 31541 mvcc.cc:205] Tried to move back new op lower bound from 7334798041292414976 to 7334798041157074944. Current Snapshot: MvccSnapshot[applied={T|T < 7334798041292414976}]
I20260929 22:49:38.053471 31543 mvcc.cc:205] Tried to move back new op lower bound from 7334798041292414976 to 7334798041157074944. Current Snapshot: MvccSnapshot[applied={T|T < 7334798041292414976}]
I20260929 22:49:38.053514 31542 mvcc.cc:205] Tried to move back new op lower bound from 7334798041292414976 to 7334798041157074944. Current Snapshot: MvccSnapshot[applied={T|T < 7334798041292414976}]
I20260929 22:49:38.055547 31062 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:38.055673 31062 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:38.056420 31062 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0267d37abb014bf39c042cfa596fdf94: Sending DeleteTablet for 3 replicas of tablet eef7f67506404f488321a7c91dc07063
I20260929 22:49:38.056739 31316 tablet_service.cc:1514] Processing DeleteTablet for tablet eef7f67506404f488321a7c91dc07063 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:38 UTC) from {username='slave'} at 127.0.0.1:50236
I20260929 22:49:38.056777 31185 tablet_service.cc:1514] Processing DeleteTablet for tablet eef7f67506404f488321a7c91dc07063 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:38 UTC) from {username='slave'} at 127.0.0.1:38050
I20260929 22:49:38.056757 31447 tablet_service.cc:1514] Processing DeleteTablet for tablet eef7f67506404f488321a7c91dc07063 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:38 UTC) from {username='slave'} at 127.0.0.1:46902
I20260929 22:49:38.056972 31551 tablet_replica.cc:330] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: stopping tablet replica
I20260929 22:49:38.057082 31551 raft_consensus.cc:2229] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:49:38.057132 31553 tablet_replica.cc:330] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: stopping tablet replica
I20260929 22:49:38.057253 31553 raft_consensus.cc:2229] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:38.057248 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31123
I20260929 22:49:38.057358 31553 raft_consensus.cc:2258] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:38.057369 31551 raft_consensus.cc:2258] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:38.057852 31553 ts_tablet_manager.cc:1905] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:38.057852 31551 ts_tablet_manager.cc:1905] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:38.059842 31553 ts_tablet_manager.cc:1918] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:38.060070 31553 log.cc:1196] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/eef7f67506404f488321a7c91dc07063
I20260929 22:49:38.060333 31553 ts_tablet_manager.cc:1939] T eef7f67506404f488321a7c91dc07063 P 098ee61e5bc0428e940bfdf21bf2f36f: Deleting consensus metadata
I20260929 22:49:38.060698 31049 catalog_manager.cc:4841] TS 098ee61e5bc0428e940bfdf21bf2f36f (127.12.27.131:38419): tablet eef7f67506404f488321a7c91dc07063 (table test-table [id=ead003bf11af4c669771742bf487b9b9]) successfully deleted
I20260929 22:49:38.060842 31551 ts_tablet_manager.cc:1918] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:38.060914 31551 log.cc:1196] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/eef7f67506404f488321a7c91dc07063
I20260929 22:49:38.061144 31551 ts_tablet_manager.cc:1939] T eef7f67506404f488321a7c91dc07063 P b4ddaffd8c574cf5bb021db6b9086429: Deleting consensus metadata
I20260929 22:49:38.061532 31050 catalog_manager.cc:4841] TS b4ddaffd8c574cf5bb021db6b9086429 (127.12.27.130:37849): tablet eef7f67506404f488321a7c91dc07063 (table test-table [id=ead003bf11af4c669771742bf487b9b9]) successfully deleted
W20260929 22:49:38.064389 31048 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:45011 (error 108)
I20260929 22:49:38.064901 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:38.064751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:45011 (local address 127.0.0.1:38066)
0929 22:49:38.064821 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:38.064868 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:45011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260929 22:49:38.064953 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31254
W20260929 22:49:38.067123 31048 catalog_manager.cc:4584] TS dfbfec7b9084457baf0ea661a1591761 (127.12.27.129:45011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eef7f67506404f488321a7c91dc07063: Network error: Client connection negotiation failed: client connection to 127.12.27.129:45011: connect: Connection refused (error 111)
I20260929 22:49:38.070498 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31385
I20260929 22:49:38.074903 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31032
2026-09-29T22:49:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (718 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:38 dist-test-slave-00d6 krb5kdc[31557](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:38 dist-test-slave-00d6 krb5kdc[31557](info): set up 2 sockets
Sep 29 22:49:38 dist-test-slave-00d6 krb5kdc[31557](info): commencing operation
krb5kdc: starting...
W20260929 22:49:39.116055 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:49:39.231959 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:37801
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:37801
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:39.312314 31570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:39.312530 31570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:39.312556 31570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:39.313782 31570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:39.313830 31570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:39.313845 31570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:39.313858 31570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:39.313915 31570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:39.315429 31570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:37801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:37801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:39.315723 31570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:39.315981 31570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:39.320797 31575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:39.320797 31576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:39.320874 31570 server_base.cc:1034] running on GCE node
W20260929 22:49:39.320832 31578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:39.321310 31570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:39.321601 31570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:39.322765 31570 hybrid_clock.cc:648] HybridClock initialized: now 1790722179322754 us; error 46 us; skew 500 ppm
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:39.325227 31570 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:49:39.325634 31570 webserver.cc:460] Webserver started at http://127.12.27.190:32961/ using document root <none> and password file <none>
I20260929 22:49:39.325877 31570 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:39.325946 31570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:39.326097 31570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:39.327136 31570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "4f4b34be35474cb6b430cd912151d8d6"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "9691aa475106b68ad1b9822839dd9c27"
server_key_iv: "54799496b82bd0323f4bdea885832101"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.327498 31570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "4f4b34be35474cb6b430cd912151d8d6"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "9691aa475106b68ad1b9822839dd9c27"
server_key_iv: "54799496b82bd0323f4bdea885832101"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.328810 31570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:39.329492 31585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.329651 31570 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:49:39.329748 31570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "4f4b34be35474cb6b430cd912151d8d6"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "9691aa475106b68ad1b9822839dd9c27"
server_key_iv: "54799496b82bd0323f4bdea885832101"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.329829 31570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:39.365684 31570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:39.368112 31570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:39.368287 31570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:39.372140 31570 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:37801
I20260929 22:49:39.372177 31637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:37801 every 8 connection(s)
I20260929 22:49:39.372571 31570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:39.373463 31638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:39.375821 31638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6: Bootstrap starting.
I20260929 22:49:39.376390 31638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:39.376678 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31570
I20260929 22:49:39.376695 31638 log.cc:824] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:39.376808 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:39.377072 12398 external_mini_cluster.cc:1428] Setting key bcbb806d7b2c9ca0fb93a80213f7b60d
I20260929 22:49:39.377487 31638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6: No bootstrap required, opened a new log
I20260929 22:49:39.379181 31638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4b34be35474cb6b430cd912151d8d6" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37801 } }
I20260929 22:49:39.379343 31638 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:39.379379 31638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f4b34be35474cb6b430cd912151d8d6, State: Initialized, Role: FOLLOWER
I20260929 22:49:39.379549 31638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4b34be35474cb6b430cd912151d8d6" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37801 } }
I20260929 22:49:39.379660 31638 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:39.379715 31638 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:39.379769 31638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:39.380730 31638 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4b34be35474cb6b430cd912151d8d6" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37801 } }
I20260929 22:49:39.380816 31638 leader_election.cc:302] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f4b34be35474cb6b430cd912151d8d6; no voters:
I20260929 22:49:39.380986 31638 leader_election.cc:288] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:39.381027 31643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:39.381197 31643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f4b34be35474cb6b430cd912151d8d6, State: Running, Role: LEADER
I20260929 22:49:39.381254 31638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:39.381363 31643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4b34be35474cb6b430cd912151d8d6" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37801 } }
I20260929 22:49:39.381742 31644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f4b34be35474cb6b430cd912151d8d6. Latest consensus state: current_term: 1 leader_uuid: "4f4b34be35474cb6b430cd912151d8d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4b34be35474cb6b430cd912151d8d6" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37801 } } }
I20260929 22:49:39.381901 31644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:39.382325 31652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:39.382566 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f4b34be35474cb6b430cd912151d8d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4b34be35474cb6b430cd912151d8d6" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37801 } } }
I20260929 22:49:39.382687 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:39.382790 31652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:39.384420 31652 catalog_manager.cc:1347] Generated new cluster ID: d011f2831410431c96b1671fea7ada70
I20260929 22:49:39.384469 31652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:39.389465 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.377615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35000 (local address 127.12.27.190:37801)
0929 22:49:39.377817 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.377824 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.377850 (+ 26us) server_negotiation.cc:407] Connection header received
0929 22:49:39.379166 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.379172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.379220 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.379331 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:39.380151 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.381233 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.382333 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.382947 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.383060 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.385825 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:39.385830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:39.385830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:39.385842 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:39.387838 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.388209 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.388212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.388212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.388341 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.388540 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.388541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.388542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.388861 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:39.389018 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.389114 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.389256 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":103,"threads_started":1}
I20260929 22:49:39.407023 31652 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:39.407781 31652 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:39.413190 31652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6: Generated new TSK 0
I20260929 22:49:39.413373 31652 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.27.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
Entry for principal kudu/127.12.27.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab.
I20260929 22:49:39.440739 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37801
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:39.520006 31664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:39.520237 31664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:39.520278 31664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:39.521425 31664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:39.521492 31664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:39.521538 31664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:39.523108 31664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.129.keytab
--principal=kudu/127.12.27.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:39.523367 31664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:39.523588 31664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:39.528451 31669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:39.528472 31670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:39.528473 31672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:39.528579 31664 server_base.cc:1034] running on GCE node
I20260929 22:49:39.528895 31664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:39.529147 31664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:39.530292 31664 hybrid_clock.cc:648] HybridClock initialized: now 1790722179530271 us; error 43 us; skew 500 ppm
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:39.532893 31664 init.cc:377] Logged in from keytab as kudu/127.12.27.129@KRBTEST.COM (short username kudu)
I20260929 22:49:39.533313 31664 webserver.cc:460] Webserver started at http://127.12.27.129:40999/ using document root <none> and password file <none>
I20260929 22:49:39.533619 31664 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:39.533690 31664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:39.533849 31664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:39.534883 31664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "d8c455b2189747eba58942275db56587"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "abef71bd3b09f7e96c0e6999e66f558c"
server_key_iv: "82bfc4fc1fa9f62a7b89af435ddfbc82"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.535244 31664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "d8c455b2189747eba58942275db56587"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "abef71bd3b09f7e96c0e6999e66f558c"
server_key_iv: "82bfc4fc1fa9f62a7b89af435ddfbc82"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.536660 31664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:39.537370 31679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.537532 31664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.537626 31664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "d8c455b2189747eba58942275db56587"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "abef71bd3b09f7e96c0e6999e66f558c"
server_key_iv: "82bfc4fc1fa9f62a7b89af435ddfbc82"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.537724 31664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:39.545989 31664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:39.547955 31664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:39.548123 31664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:39.548362 31664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:39.548671 31664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:39.548727 31664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.548776 31664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:39.548804 31664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.554806 31664 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:39953
I20260929 22:49:39.554844 31792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:39953 every 8 connection(s)
I20260929 22:49:39.555181 31664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:49:39.555824 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31664
I20260929 22:49:39.555940 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:49:39.556187 12398 external_mini_cluster.cc:1428] Setting key 81c55b971123ddc3462443b3cc457fa6
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.129@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.27.130@KRBTEST.COM; defaulting to no policy
I20260929 22:49:39.565307 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.556494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:37575 (local address 127.12.27.190:37801)
0929 22:49:39.556561 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.556563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.556574 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:39.557035 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.557036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.557050 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.557108 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:39.558085 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.558588 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.559607 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.559861 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.559950 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.562273 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:39.562274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:39.562275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:39.562288 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:39.563807 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.564280 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.564281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.564282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.564341 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.564603 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.564604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.564604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.564727 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:39.564800 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.565117 (+ 317us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.565209 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 22:49:39.565515 31795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.556021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37801 (local address 127.12.27.129:37575)
0929 22:49:39.556217 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:39.556279 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:39.556933 (+ 654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:39.557211 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:39.557215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:39.557787 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:39.557977 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.557982 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.558697 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.558698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.559504 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.559506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.559962 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.559963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.560091 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.560690 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:39.560698 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:39.562153 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:39.563892 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:39.563898 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:39.563901 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:39.564191 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:39.564409 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:39.564410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:39.564410 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:39.564530 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:39.564805 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:39.564812 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:39.564954 (+ 142us) client_negotiation.cc:769] Sending connection context
0929 22:49:39.565094 (+ 140us) client_negotiation.cc:240] Negotiation successful
0929 22:49:39.565270 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260929 22:49:39.566083 31793 heartbeater.cc:347] Connected to a master server at 127.12.27.190:37801
I20260929 22:49:39.566202 31793 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:39.566404 31793 heartbeater.cc:511] Master 127.12.27.190:37801 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.130@KRBTEST.COM" created.
I20260929 22:49:39.567029 31602 ts_manager.cc:194] Registered new tserver with Master: d8c455b2189747eba58942275db56587 (127.12.27.129:39953)
I20260929 22:49:39.567734 31602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.129@KRBTEST.COM'} at 127.12.27.129:37575
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
Entry for principal kudu/127.12.27.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab.
I20260929 22:49:39.582731 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37801
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:39.662832 31798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:39.663024 31798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:39.663048 31798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:39.664193 31798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:39.664239 31798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:39.664297 31798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:39.665738 31798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.130.keytab
--principal=kudu/127.12.27.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:39.665975 31798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:39.666198 31798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:39.670985 31806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:39.670990 31803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:39.671072 31798 server_base.cc:1034] running on GCE node
W20260929 22:49:39.670992 31804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:39.671429 31798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:39.671712 31798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:39.672881 31798 hybrid_clock.cc:648] HybridClock initialized: now 1790722179672876 us; error 36 us; skew 500 ppm
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:39.675267 31798 init.cc:377] Logged in from keytab as kudu/127.12.27.130@KRBTEST.COM (short username kudu)
I20260929 22:49:39.675613 31798 webserver.cc:460] Webserver started at http://127.12.27.130:44435/ using document root <none> and password file <none>
I20260929 22:49:39.675854 31798 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:39.675896 31798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:39.675980 31798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:39.676967 31798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "32a2db90139243d094909e84b55b6007"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "ad58706cbb4d991b5ab4ccfc20f98779"
server_key_iv: "4ce851160dcedbf2edf62b52b6f1e744"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.677263 31798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "32a2db90139243d094909e84b55b6007"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "ad58706cbb4d991b5ab4ccfc20f98779"
server_key_iv: "4ce851160dcedbf2edf62b52b6f1e744"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.678471 31798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:39.679121 31813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.679294 31798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:49:39.679381 31798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "32a2db90139243d094909e84b55b6007"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "ad58706cbb4d991b5ab4ccfc20f98779"
server_key_iv: "4ce851160dcedbf2edf62b52b6f1e744"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.679455 31798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:39.699275 31798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:39.702085 31798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:39.702242 31798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:39.702502 31798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:39.702838 31798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:39.702894 31798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.702929 31798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:39.702956 31798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.708843 31798 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:37869
I20260929 22:49:39.708881 31926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:37869 every 8 connection(s)
I20260929 22:49:39.709224 31798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.130@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:39.717732 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31798
I20260929 22:49:39.717837 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:49:39.718060 12398 external_mini_cluster.cc:1428] Setting key 87725a469167b331709ee6d60ad3ad53
I20260929 22:49:39.718243 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.709976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:40353 (local address 127.12.27.190:37801)
0929 22:49:39.710021 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.710022 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.710237 (+ 215us) server_negotiation.cc:407] Connection header received
0929 22:49:39.710774 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.710775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.710787 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.710841 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:39.711822 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.712342 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.713338 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.713536 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.713617 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.715666 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:39.715668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:39.715668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:39.715675 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:39.716858 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.717229 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.717230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.717230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.717282 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.717497 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.717498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.717498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.717644 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:39.717700 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.718039 (+ 339us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.718129 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:49:39.718406 31929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.709947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37801 (local address 127.12.27.130:40353)
0929 22:49:39.710121 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:39.710155 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:39.710657 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:39.710905 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:39.710909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:39.711465 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:39.711717 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.711723 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.712437 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.712438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.713245 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.713247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.713625 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.713626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.713771 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.714203 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:39.714211 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:39.715544 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:39.716930 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:39.716936 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:39.716937 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:39.717136 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:39.717342 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:39.717343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:39.717343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:39.717435 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:39.717715 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:39.717722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:39.717890 (+ 168us) client_negotiation.cc:769] Sending connection context
0929 22:49:39.718004 (+ 114us) client_negotiation.cc:240] Negotiation successful
0929 22:49:39.718164 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
I20260929 22:49:39.718854 31927 heartbeater.cc:347] Connected to a master server at 127.12.27.190:37801
I20260929 22:49:39.718971 31927 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:39.719141 31927 heartbeater.cc:511] Master 127.12.27.190:37801 requested a full tablet report, sending...
I20260929 22:49:39.719539 31602 ts_manager.cc:194] Registered new tserver with Master: 32a2db90139243d094909e84b55b6007 (127.12.27.130:37869)
I20260929 22:49:39.719933 31602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.130@KRBTEST.COM'} at 127.12.27.130:40353
WARNING: no policy specified for kudu/127.12.27.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
Entry for principal kudu/127.12.27.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab.
I20260929 22:49:39.744836 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37801
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:39.824019 31932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:39.824247 31932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:39.824286 31932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:39.825423 31932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:39.825489 31932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:39.825536 31932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:39.826946 31932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.131.keytab
--principal=kudu/127.12.27.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:37801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:39.827209 31932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:39.827425 31932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:49:39.832425 31932 server_base.cc:1034] running on GCE node
W20260929 22:49:39.832381 31940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:39.832407 31938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:39.832392 31937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:39.832880 31932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:39.833112 31932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:39.834275 31932 hybrid_clock.cc:648] HybridClock initialized: now 1790722179834265 us; error 28 us; skew 500 ppm
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:39.836623 31932 init.cc:377] Logged in from keytab as kudu/127.12.27.131@KRBTEST.COM (short username kudu)
I20260929 22:49:39.837085 31932 webserver.cc:460] Webserver started at http://127.12.27.131:45529/ using document root <none> and password file <none>
I20260929 22:49:39.837317 31932 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:39.837386 31932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:39.837530 31932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:39.838510 31932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "0c9420bf081c1427650afc1114a3cf69"
server_key_iv: "b52cba7c10ffd8021747394a73c3fffb"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.838860 31932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "0c9420bf081c1427650afc1114a3cf69"
server_key_iv: "b52cba7c10ffd8021747394a73c3fffb"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.840207 31932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 22:49:39.840960 31947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.841123 31932 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:39.841212 31932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc"
format_stamp: "Formatted at 2026-09-29 22:49:39 on dist-test-slave-00d6"
server_key: "0c9420bf081c1427650afc1114a3cf69"
server_key_iv: "b52cba7c10ffd8021747394a73c3fffb"
server_key_version: "encryptionkey@0"
I20260929 22:49:39.841293 31932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:39.865042 31932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:39.867918 31932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:39.868077 31932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:39.868363 31932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:39.868737 31932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:39.868789 31932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.868824 31932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:39.868851 31932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:39.876717 31932 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:44587
I20260929 22:49:39.876789 32060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:44587 every 8 connection(s)
I20260929 22:49:39.877116 31932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:49:39.879568 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 31932
I20260929 22:49:39.879823 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:49:39.880028 12398 external_mini_cluster.cc:1428] Setting key 26be0a9522363e0d4f20d63b3e89e543
Sep 29 22:49:39 dist-test-slave-00d6 krb5kdc[31557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722179, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.131@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:39.887892 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.877878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:39715 (local address 127.12.27.190:37801)
0929 22:49:39.877950 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.877952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.878212 (+ 260us) server_negotiation.cc:407] Connection header received
0929 22:49:39.878708 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.878709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.878719 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.878780 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:39.879867 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.880473 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.881952 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.882216 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.882286 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.884481 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:39.884482 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:39.884483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:39.884489 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:39.886339 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.886815 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.886815 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.886816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.886870 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.887130 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.887132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.887132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.887249 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:39.887318 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.887751 (+ 433us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.887829 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 22:49:39.888067 32063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.877849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:37801 (local address 127.12.27.131:39715)
0929 22:49:39.878092 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:39.878135 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:39.878623 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:39.878851 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:39.878854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:39.879468 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:39.879744 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.879751 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.880572 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.880573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.881793 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.881800 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.882301 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.882301 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.882452 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.882926 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:49:39.882934 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:39.884395 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:39.886444 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:39.886451 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:39.886453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:39.886743 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:39.886916 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:49:39.886916 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:49:39.886917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:49:39.887010 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:49:39.887412 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:39.887418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:39.887551 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 22:49:39.887723 (+ 172us) client_negotiation.cc:240] Negotiation successful
0929 22:49:39.887854 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260929 22:49:39.888533 32061 heartbeater.cc:347] Connected to a master server at 127.12.27.190:37801
I20260929 22:49:39.888619 32061 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:39.888751 32061 heartbeater.cc:511] Master 127.12.27.190:37801 requested a full tablet report, sending...
I20260929 22:49:39.889108 31602 ts_manager.cc:194] Registered new tserver with Master: 6c1e54c8bd25492db96c7b2e5c7d38cc (127.12.27.131:44587)
I20260929 22:49:39.889493 31602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.27.131@KRBTEST.COM'} at 127.12.27.131:39715
I20260929 22:49:39.891856 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:49:39.899685 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.893324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35002 (local address 127.12.27.190:37801)
0929 22:49:39.893397 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.893400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.893504 (+ 104us) server_negotiation.cc:407] Connection header received
0929 22:49:39.893590 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.893591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.893602 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.893656 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:39.894275 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.894787 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.895610 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.895858 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.895951 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.897174 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:39.897175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:39.897176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:39.897183 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:39.898410 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.898803 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.898804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.898805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.898869 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:39.899085 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:39.899086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:39.899086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:39.899241 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:39.899359 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.899468 (+ 109us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.899550 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 22:49:39.901216 31602 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:49:39.902680 31602 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:49:39.909247 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.904805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:39953 (local address 127.0.0.1:54802)
0929 22:49:39.905106 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:39.905148 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:39.905215 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:39.905543 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:39.905546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:39.905549 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:39.905637 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.905641 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.906712 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.906713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.908104 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.908107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.908963 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.908964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.909036 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.909051 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 22:49:39.909125 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 22:49:39.909173 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":9,"thread_start_us":84,"threads_started":1}
I20260929 22:49:39.909260 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.905152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54802 (local address 127.12.27.129:39953)
0929 22:49:39.905346 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.905351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.905361 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:49:39.905397 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.905398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.905414 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.905489 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:39.905752 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.906608 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.908196 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.908872 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.908963 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.909039 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.909139 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.909182 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260929 22:49:39.909698 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.904928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55866 (local address 127.12.27.131:44587)
0929 22:49:39.905102 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.905107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.905229 (+ 122us) server_negotiation.cc:407] Connection header received
0929 22:49:39.905367 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.905370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.905387 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.905471 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:39.905798 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.906971 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.908350 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.909001 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.909089 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.909142 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.909540 (+ 398us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.909592 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260929 22:49:39.909961 32072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.904841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:44587 (local address 127.0.0.1:55866)
0929 22:49:39.905152 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:39.905162 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:39.905257 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:39.905543 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:39.905546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:39.905551 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:39.905637 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.905640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.907085 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.907086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.908270 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.908272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.909180 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.909181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.909248 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.909252 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:39.909307 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 22:49:39.909876 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":3,"thread_start_us":55,"threads_started":1}
I20260929 22:49:39.910035 31727 tablet_service.cc:1467] Processing CreateTablet for tablet ab4a11af6ebc42e3afd3e27c26a5c819 (DEFAULT_TABLE table=test-table [id=8f8db31017f8437d958ce94a7c10f57e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:39.910249 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.905032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:37869 (local address 127.0.0.1:42830)
0929 22:49:39.905579 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:39.905588 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:39.905670 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:39.906218 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:39.906219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:39.906221 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:39.906349 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.906353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.907511 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.907512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.908588 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:39.908591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.909717 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.909718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:39.909786 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.909790 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:39.909836 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 22:49:39.909875 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":36,"threads_started":1}
I20260929 22:49:39.910419 31727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab4a11af6ebc42e3afd3e27c26a5c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:39.910517 32074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:39.905157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42830 (local address 127.12.27.130:37869)
0929 22:49:39.905341 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:39.905345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:39.905669 (+ 324us) server_negotiation.cc:407] Connection header received
0929 22:49:39.906050 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:39.906053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:39.906068 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:39.906142 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:39.906466 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.907406 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.908680 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:39.909628 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:39.909716 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:39.909940 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:39.909969 (+ 29us) server_negotiation.cc:299] Negotiation successful
0929 22:49:39.910179 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
I20260929 22:49:39.910722 31995 tablet_service.cc:1467] Processing CreateTablet for tablet ab4a11af6ebc42e3afd3e27c26a5c819 (DEFAULT_TABLE table=test-table [id=8f8db31017f8437d958ce94a7c10f57e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:39.911034 31995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab4a11af6ebc42e3afd3e27c26a5c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:39.912379 31861 tablet_service.cc:1467] Processing CreateTablet for tablet ab4a11af6ebc42e3afd3e27c26a5c819 (DEFAULT_TABLE table=test-table [id=8f8db31017f8437d958ce94a7c10f57e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:39.912743 31861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab4a11af6ebc42e3afd3e27c26a5c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:39.914371 32075 tablet_bootstrap.cc:492] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Bootstrap starting.
I20260929 22:49:39.914736 32076 tablet_bootstrap.cc:492] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: Bootstrap starting.
I20260929 22:49:39.915246 32075 tablet_bootstrap.cc:654] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:39.915409 32076 tablet_bootstrap.cc:654] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:39.916004 32077 tablet_bootstrap.cc:492] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Bootstrap starting.
I20260929 22:49:39.916101 32076 log.cc:824] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:39.916484 32075 log.cc:824] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:39.916695 32077 tablet_bootstrap.cc:654] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:39.917018 32076 tablet_bootstrap.cc:492] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: No bootstrap required, opened a new log
I20260929 22:49:39.917098 32076 ts_tablet_manager.cc:1397] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 22:49:39.917291 32077 log.cc:824] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:39.917330 32075 tablet_bootstrap.cc:492] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: No bootstrap required, opened a new log
I20260929 22:49:39.917444 32075 ts_tablet_manager.cc:1397] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 22:49:39.917989 32077 tablet_bootstrap.cc:492] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: No bootstrap required, opened a new log
I20260929 22:49:39.918077 32077 ts_tablet_manager.cc:1397] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:39.919103 32076 raft_consensus.cc:348] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:39.919291 32076 raft_consensus.cc:374] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:39.919329 32076 raft_consensus.cc:729] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c455b2189747eba58942275db56587, State: Initialized, Role: FOLLOWER
I20260929 22:49:39.919355 32075 raft_consensus.cc:348] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:39.919513 32075 raft_consensus.cc:374] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:39.919472 32076 consensus_queue.cc:260] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:39.919559 32075 raft_consensus.cc:729] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c1e54c8bd25492db96c7b2e5c7d38cc, State: Initialized, Role: FOLLOWER
I20260929 22:49:39.919725 32075 consensus_queue.cc:260] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:39.919808 32076 ts_tablet_manager.cc:1428] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 22:49:39.919689 32077 raft_consensus.cc:348] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:39.919878 32077 raft_consensus.cc:374] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:39.919922 32077 raft_consensus.cc:729] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32a2db90139243d094909e84b55b6007, State: Initialized, Role: FOLLOWER
I20260929 22:49:39.919957 31793 heartbeater.cc:503] Master 127.12.27.190:37801 was elected leader, sending a full tablet report...
I20260929 22:49:39.919979 32075 ts_tablet_manager.cc:1428] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 22:49:39.920038 32077 consensus_queue.cc:260] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:39.920321 32077 ts_tablet_manager.cc:1428] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:49:39.920439 32061 heartbeater.cc:503] Master 127.12.27.190:37801 was elected leader, sending a full tablet report...
I20260929 22:49:39.920715 31927 heartbeater.cc:503] Master 127.12.27.190:37801 was elected leader, sending a full tablet report...
W20260929 22:49:39.959805 31928 tablet.cc:2369] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 22:49:40.056003 31794 tablet.cc:2369] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:49:40.100895 32083 raft_consensus.cc:482] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:40.101078 32083 raft_consensus.cc:504] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:40.101504 32083 leader_election.cc:288] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8c455b2189747eba58942275db56587 (127.12.27.129:39953), 6c1e54c8bd25492db96c7b2e5c7d38cc (127.12.27.131:44587)
I20260929 22:49:40.104599 31929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.101717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:44587 (local address 127.12.27.130:56709)
0929 22:49:40.101775 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.101789 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.101841 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.101995 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.101996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.101998 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.102079 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.102081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.102845 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.102846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.103686 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.103689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.104343 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.104344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.104427 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.104432 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.104490 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.104536 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 22:49:40.104686 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.101810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:56709 (local address 127.12.27.131:44587)
0929 22:49:40.101867 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.101869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.101880 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:40.101910 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.101911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.101921 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.101992 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.102182 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.102765 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.103797 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.104267 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.104325 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.104332 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.104514 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.104557 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:49:40.104805 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.101838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:44169 (local address 127.12.27.129:39953)
0929 22:49:40.101887 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.101889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.102129 (+ 240us) server_negotiation.cc:407] Connection header received
0929 22:49:40.102193 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.102194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.102203 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.102254 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.102411 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.102915 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.104027 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.104426 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.104500 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.104507 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.104685 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.104732 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 22:49:40.104985 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.101732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:39953 (local address 127.12.27.130:44169)
0929 22:49:40.102036 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.102046 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.102118 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.102271 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.102272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.102274 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.102340 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.102342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.103043 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.103043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.103937 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.103940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.104520 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.104520 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.104595 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.104599 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.104808 (+ 209us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.104915 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":129,"thread_start_us":115,"threads_started":1}
I20260929 22:49:40.104997 32015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4a11af6ebc42e3afd3e27c26a5c819" candidate_uuid: "32a2db90139243d094909e84b55b6007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" is_pre_election: true
I20260929 22:49:40.105144 32015 raft_consensus.cc:2454] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32a2db90139243d094909e84b55b6007 in term 0.
I20260929 22:49:40.105408 31816 leader_election.cc:302] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32a2db90139243d094909e84b55b6007, 6c1e54c8bd25492db96c7b2e5c7d38cc; no voters:
I20260929 22:49:40.105374 31747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4a11af6ebc42e3afd3e27c26a5c819" candidate_uuid: "32a2db90139243d094909e84b55b6007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c455b2189747eba58942275db56587" is_pre_election: true
I20260929 22:49:40.105530 31747 raft_consensus.cc:2454] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32a2db90139243d094909e84b55b6007 in term 0.
I20260929 22:49:40.105556 32083 raft_consensus.cc:2781] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:49:40.105635 32083 raft_consensus.cc:482] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:49:40.105675 32083 raft_consensus.cc:3037] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.106397 32083 raft_consensus.cc:504] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:40.106537 32083 leader_election.cc:288] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [CANDIDATE]: Term 1 election: Requested vote from peers d8c455b2189747eba58942275db56587 (127.12.27.129:39953), 6c1e54c8bd25492db96c7b2e5c7d38cc (127.12.27.131:44587)
I20260929 22:49:40.106712 31747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4a11af6ebc42e3afd3e27c26a5c819" candidate_uuid: "32a2db90139243d094909e84b55b6007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c455b2189747eba58942275db56587"
I20260929 22:49:40.106720 32015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4a11af6ebc42e3afd3e27c26a5c819" candidate_uuid: "32a2db90139243d094909e84b55b6007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc"
I20260929 22:49:40.106796 31747 raft_consensus.cc:3037] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.106802 32015 raft_consensus.cc:3037] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.107520 32015 raft_consensus.cc:2454] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32a2db90139243d094909e84b55b6007 in term 1.
I20260929 22:49:40.107527 31747 raft_consensus.cc:2454] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32a2db90139243d094909e84b55b6007 in term 1.
I20260929 22:49:40.107707 31816 leader_election.cc:302] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32a2db90139243d094909e84b55b6007, 6c1e54c8bd25492db96c7b2e5c7d38cc; no voters:
I20260929 22:49:40.107810 32083 raft_consensus.cc:2781] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:40.107969 32083 raft_consensus.cc:686] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 1 LEADER]: Becoming Leader. State: Replica: 32a2db90139243d094909e84b55b6007, State: Running, Role: LEADER
I20260929 22:49:40.108074 32083 consensus_queue.cc:237] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } }
I20260929 22:49:40.108906 31602 catalog_manager.cc:5495] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32a2db90139243d094909e84b55b6007 (127.12.27.130). New cstate: current_term: 1 leader_uuid: "32a2db90139243d094909e84b55b6007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32a2db90139243d094909e84b55b6007" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 37869 } health_report { overall_health: HEALTHY } } }
W20260929 22:49:40.127803 32062 tablet.cc:2369] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 22:49:40.134526 32074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.132153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42846 (local address 127.12.27.130:37869)
0929 22:49:40.132213 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.132215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.132223 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:49:40.132264 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.132265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.132289 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.132358 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:49:40.132506 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.132989 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.133770 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.133964 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.134044 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.134209 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:49:40.134311 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:49:40.134403 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.134421 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.134440 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:49:40.136444 32015 raft_consensus.cc:1261] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 1 FOLLOWER]: Refusing update from remote peer 32a2db90139243d094909e84b55b6007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:40.136444 31747 raft_consensus.cc:1261] T ab4a11af6ebc42e3afd3e27c26a5c819 P d8c455b2189747eba58942275db56587 [term 1 FOLLOWER]: Refusing update from remote peer 32a2db90139243d094909e84b55b6007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:40.136824 32085 consensus_queue.cc:1035] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c455b2189747eba58942275db56587" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 39953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:40.136960 32083 consensus_queue.cc:1035] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c1e54c8bd25492db96c7b2e5c7d38cc" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 44587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:40.140498 32089 mvcc.cc:205] Tried to move back new op lower bound from 7334798049835868160 to 7334798049723305984. Current Snapshot: MvccSnapshot[applied={T|T < 7334798049835868160}]
I20260929 22:49:40.141703 31601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:40.141793 31601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:40.142513 31601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f4b34be35474cb6b430cd912151d8d6: Sending DeleteTablet for 3 replicas of tablet ab4a11af6ebc42e3afd3e27c26a5c819
I20260929 22:49:40.142830 31727 tablet_service.cc:1514] Processing DeleteTablet for tablet ab4a11af6ebc42e3afd3e27c26a5c819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:40 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:54802
I20260929 22:49:40.142871 31995 tablet_service.cc:1514] Processing DeleteTablet for tablet ab4a11af6ebc42e3afd3e27c26a5c819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:40 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:55866
I20260929 22:49:40.142879 31861 tablet_service.cc:1514] Processing DeleteTablet for tablet ab4a11af6ebc42e3afd3e27c26a5c819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:40 UTC) from {username='kudu', principal='kudu/127.12.27.190@KRBTEST.COM'} at 127.0.0.1:42830
I20260929 22:49:40.143072 32100 tablet_replica.cc:330] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: stopping tablet replica
I20260929 22:49:40.143167 32100 raft_consensus.cc:2229] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:49:40.143270 32100 raft_consensus.cc:2258] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:40.143272 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31664
I20260929 22:49:40.143791 32100 ts_tablet_manager.cc:1905] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:40.143889 32099 tablet_replica.cc:330] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: stopping tablet replica
I20260929 22:49:40.143981 32099 raft_consensus.cc:2229] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:40.144081 32099 raft_consensus.cc:2258] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:40.144578 32099 ts_tablet_manager.cc:1905] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:40.145893 32100 ts_tablet_manager.cc:1918] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:40.146014 32100 log.cc:1196] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-1/wal/wals/ab4a11af6ebc42e3afd3e27c26a5c819
I20260929 22:49:40.146162 32099 ts_tablet_manager.cc:1918] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:40.146320 32099 log.cc:1196] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/ab4a11af6ebc42e3afd3e27c26a5c819
I20260929 22:49:40.146363 32100 ts_tablet_manager.cc:1939] T ab4a11af6ebc42e3afd3e27c26a5c819 P 32a2db90139243d094909e84b55b6007: Deleting consensus metadata
I20260929 22:49:40.146672 32099 ts_tablet_manager.cc:1939] T ab4a11af6ebc42e3afd3e27c26a5c819 P 6c1e54c8bd25492db96c7b2e5c7d38cc: Deleting consensus metadata
I20260929 22:49:40.146772 31588 catalog_manager.cc:4841] TS 32a2db90139243d094909e84b55b6007 (127.12.27.130:37869): tablet ab4a11af6ebc42e3afd3e27c26a5c819 (table test-table [id=8f8db31017f8437d958ce94a7c10f57e]) successfully deleted
I20260929 22:49:40.147215 31588 catalog_manager.cc:4841] TS 6c1e54c8bd25492db96c7b2e5c7d38cc (127.12.27.131:44587): tablet ab4a11af6ebc42e3afd3e27c26a5c819 (table test-table [id=8f8db31017f8437d958ce94a7c10f57e]) successfully deleted
W20260929 22:49:40.149214 31589 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:39953 (error 108)
I20260929 22:49:40.149664 32072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.149531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:39953 (local address 127.0.0.1:54812)
0929 22:49:40.149589 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.149627 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:39953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:49:40.149729 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31798
W20260929 22:49:40.151243 31589 catalog_manager.cc:4584] TS d8c455b2189747eba58942275db56587 (127.12.27.129:39953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab4a11af6ebc42e3afd3e27c26a5c819: Network error: Client connection negotiation failed: client connection to 127.12.27.129:39953: connect: Connection refused (error 111)
I20260929 22:49:40.154896 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31932
I20260929 22:49:40.159041 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 31570
2026-09-29T22:49:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2084 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-29T22:49:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:40Z Disabled control of system clock
I20260929 22:49:40.185940 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:44013
--webserver_interface=127.12.27.190
--webserver_port=0
--builtin_ntp_servers=127.12.27.148:41327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:44013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:40.265547 32105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:40.265756 32105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:40.265777 32105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:40.266848 32105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:40.266885 32105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:40.266897 32105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:40.266911 32105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:40.266922 32105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:40.268180 32105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:44013
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:44013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:40.268370 32105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:40.268597 32105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:49:40.273485 32105 server_base.cc:1034] running on GCE node
W20260929 22:49:40.273453 32110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:40.273422 32111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:40.273430 32113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.273862 32105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:40.274119 32105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:40.275267 32105 hybrid_clock.cc:648] HybridClock initialized: now 1790722180275255 us; error 32 us; skew 500 ppm
I20260929 22:49:40.276523 32105 webserver.cc:460] Webserver started at http://127.12.27.190:37499/ using document root <none> and password file <none>
I20260929 22:49:40.276772 32105 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:40.276819 32105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:40.276983 32105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:40.278028 32105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "389528ee376046168905b28ebfa268e5"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "28dad5d1326eb6c3d96629dd42f0b3e1"
server_key_iv: "09ba4219ad41e54b25a5eed14b3f0769"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.278386 32105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "389528ee376046168905b28ebfa268e5"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "28dad5d1326eb6c3d96629dd42f0b3e1"
server_key_iv: "09ba4219ad41e54b25a5eed14b3f0769"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.279717 32105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:40.280431 32119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.280602 32105 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:40.280685 32105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "389528ee376046168905b28ebfa268e5"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "28dad5d1326eb6c3d96629dd42f0b3e1"
server_key_iv: "09ba4219ad41e54b25a5eed14b3f0769"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.280762 32105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:40.304256 32105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:40.304592 32105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:40.304742 32105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:40.308543 32105 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:44013
I20260929 22:49:40.308578 32171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:44013 every 8 connection(s)
I20260929 22:49:40.308928 32105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:40.309872 32172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:40.310211 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 32105
I20260929 22:49:40.310320 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:40.310521 12398 external_mini_cluster.cc:1428] Setting key 02f0fffb18449ce9f34c03f768da99cb
I20260929 22:49:40.312855 32172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5: Bootstrap starting.
I20260929 22:49:40.313524 32172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:40.313828 32172 log.cc:824] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:40.314496 32172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5: No bootstrap required, opened a new log
I20260929 22:49:40.316108 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.311055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50948 (local address 127.12.27.190:44013)
0929 22:49:40.311249 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.311257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.311285 (+ 28us) server_negotiation.cc:407] Connection header received
0929 22:49:40.311793 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.311800 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.311864 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.311984 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:40.312219 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.313132 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.314201 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.314682 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.314776 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.315431 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:40.315435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:40.315435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:40.315595 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:40.315665 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:40.315681 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:40.315737 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.315835 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.315913 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260929 22:49:40.316869 32172 raft_consensus.cc:348] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389528ee376046168905b28ebfa268e5" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 44013 } }
I20260929 22:49:40.316994 32172 raft_consensus.cc:374] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:40.317015 32172 raft_consensus.cc:729] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389528ee376046168905b28ebfa268e5, State: Initialized, Role: FOLLOWER
I20260929 22:49:40.317152 32172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389528ee376046168905b28ebfa268e5" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 44013 } }
I20260929 22:49:40.317209 32172 raft_consensus.cc:388] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:40.317255 32172 raft_consensus.cc:482] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:40.317303 32172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.317806 32172 raft_consensus.cc:504] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389528ee376046168905b28ebfa268e5" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 44013 } }
I20260929 22:49:40.317909 32172 leader_election.cc:302] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 389528ee376046168905b28ebfa268e5; no voters:
I20260929 22:49:40.318084 32172 leader_election.cc:288] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:40.318154 32177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:40.318306 32177 raft_consensus.cc:686] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [term 1 LEADER]: Becoming Leader. State: Replica: 389528ee376046168905b28ebfa268e5, State: Running, Role: LEADER
I20260929 22:49:40.318329 32172 sys_catalog.cc:564] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:40.318403 32177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389528ee376046168905b28ebfa268e5" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 44013 } }
I20260929 22:49:40.318771 32178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "389528ee376046168905b28ebfa268e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389528ee376046168905b28ebfa268e5" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 44013 } } }
I20260929 22:49:40.318866 32178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:40.318974 32179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 389528ee376046168905b28ebfa268e5. Latest consensus state: current_term: 1 leader_uuid: "389528ee376046168905b28ebfa268e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "389528ee376046168905b28ebfa268e5" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 44013 } } }
I20260929 22:49:40.319137 32179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:40.319356 32186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:40.319821 32186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:40.321308 32186 catalog_manager.cc:1347] Generated new cluster ID: 44c1916bf3904837a2d1d42a2fe5d8f8
I20260929 22:49:40.321358 32186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:40.343695 32186 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:40.344437 32186 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:40.359357 32186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5: Generated new TSK 0
I20260929 22:49:40.359562 32186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:40.364046 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.129:0
--local_ip_for_outbound_sockets=127.12.27.129
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:44013
--builtin_ntp_servers=127.12.27.148:41327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:40.443513 32196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:40.443733 32196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:40.443755 32196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:40.444861 32196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:40.444896 32196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:40.444921 32196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.129
I20260929 22:49:40.446168 32196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.27.129
--webserver_port=0
--tserver_master_addrs=127.12.27.190:44013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.129
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:40.446353 32196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:40.446590 32196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:40.451469 32204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:40.451472 32202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.451573 32196 server_base.cc:1034] running on GCE node
W20260929 22:49:40.451529 32201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.451978 32196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:40.452188 32196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:40.453325 32196 hybrid_clock.cc:648] HybridClock initialized: now 1790722180453314 us; error 27 us; skew 500 ppm
I20260929 22:49:40.454530 32196 webserver.cc:460] Webserver started at http://127.12.27.129:35553/ using document root <none> and password file <none>
I20260929 22:49:40.454818 32196 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:40.454866 32196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:40.455036 32196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:40.456121 32196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data/instance:
uuid: "95d133fbb4cd4c04acb52e47a61d15a8"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "a8bca84af5e5a1e30f00d779a7672b35"
server_key_iv: "e4d0b5f5674491c807d2bb5de0b2a1af"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.456454 32196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance:
uuid: "95d133fbb4cd4c04acb52e47a61d15a8"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "a8bca84af5e5a1e30f00d779a7672b35"
server_key_iv: "e4d0b5f5674491c807d2bb5de0b2a1af"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.457686 32196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:40.458376 32210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.458541 32196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:40.458622 32196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal
uuid: "95d133fbb4cd4c04acb52e47a61d15a8"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "a8bca84af5e5a1e30f00d779a7672b35"
server_key_iv: "e4d0b5f5674491c807d2bb5de0b2a1af"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.458699 32196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:40.474858 32196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:40.475132 32196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:40.475270 32196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:40.475466 32196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:40.475831 32196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:40.475879 32196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.475919 32196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:40.475945 32196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.481884 32196 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.129:38599
I20260929 22:49:40.481920 32323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.129:38599 every 8 connection(s)
I20260929 22:49:40.482254 32196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/data/info.pb
I20260929 22:49:40.487569 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.482991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.129:39625 (local address 127.12.27.190:44013)
0929 22:49:40.483046 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.483048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.483296 (+ 248us) server_negotiation.cc:407] Connection header received
0929 22:49:40.483916 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.483917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.483929 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.483997 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:40.484688 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.485206 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.486182 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.486391 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.486474 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.487273 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:40.487274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:40.487275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:40.487280 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:40.487295 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:40.487299 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:40.487365 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.487453 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.487487 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:49:40.487867 32326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.482979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:44013 (local address 127.12.27.129:39625)
0929 22:49:40.483170 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.483203 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.483814 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.484070 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.484074 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.484082 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:40.484596 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.484600 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.485310 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.485311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.486090 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.486092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.486487 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.486488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.486613 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.487123 (+ 510us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:40.487123 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:40.487150 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:40.487171 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:40.487366 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:40.487373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:40.487376 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.487457 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.487556 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260929 22:49:40.488440 32324 heartbeater.cc:347] Connected to a master server at 127.12.27.190:44013
I20260929 22:49:40.488543 32324 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:40.488682 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 32196
I20260929 22:49:40.488765 32324 heartbeater.cc:511] Master 127.12.27.190:44013 requested a full tablet report, sending...
I20260929 22:49:40.488782 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-0/wal/instance
I20260929 22:49:40.488999 12398 external_mini_cluster.cc:1428] Setting key 82968260dfcf8bc9252afd538d4d011f
I20260929 22:49:40.489313 32136 ts_manager.cc:194] Registered new tserver with Master: 95d133fbb4cd4c04acb52e47a61d15a8 (127.12.27.129:38599)
I20260929 22:49:40.490072 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.130:0
--local_ip_for_outbound_sockets=127.12.27.130
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:44013
--builtin_ntp_servers=127.12.27.148:41327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 22:49:40.490078 32136 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.129:39625
W20260929 22:49:40.569860 32327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:40.570060 32327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:40.570083 32327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:40.571235 32327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:40.571285 32327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:40.571332 32327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.130
I20260929 22:49:40.572759 32327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.27.130
--webserver_port=0
--tserver_master_addrs=127.12.27.190:44013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.130
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:40.573006 32327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:40.573314 32327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:40.578348 32332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:40.578477 32335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.578507 32327 server_base.cc:1034] running on GCE node
W20260929 22:49:40.578615 32333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.578961 32327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:40.579238 32327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:40.580396 32327 hybrid_clock.cc:648] HybridClock initialized: now 1790722180580362 us; error 45 us; skew 500 ppm
I20260929 22:49:40.581967 32327 webserver.cc:460] Webserver started at http://127.12.27.130:36175/ using document root <none> and password file <none>
I20260929 22:49:40.582288 32327 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:40.582357 32327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:40.582507 32327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:40.583884 32327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data/instance:
uuid: "96a4e64164a14bb9aef1a12b3f5caf8e"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "66f7c96599fe294a771a8b16f43d569a"
server_key_iv: "043e85f7165b2a719a8e2a9765f09cb9"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.584321 32327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance:
uuid: "96a4e64164a14bb9aef1a12b3f5caf8e"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "66f7c96599fe294a771a8b16f43d569a"
server_key_iv: "043e85f7165b2a719a8e2a9765f09cb9"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.585865 32327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:40.586599 32341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.586776 32327 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:40.586854 32327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal
uuid: "96a4e64164a14bb9aef1a12b3f5caf8e"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "66f7c96599fe294a771a8b16f43d569a"
server_key_iv: "043e85f7165b2a719a8e2a9765f09cb9"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.586925 32327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:40.598519 32327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:40.598793 32327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:40.598927 32327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:40.599131 32327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:40.599440 32327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:40.599474 32327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.599512 32327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:40.599539 32327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.605304 32327 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.130:41881
I20260929 22:49:40.605351 32455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.130:41881 every 8 connection(s)
I20260929 22:49:40.605661 32327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/data/info.pb
I20260929 22:49:40.610476 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.606340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.130:58105 (local address 127.12.27.190:44013)
0929 22:49:40.606399 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.606401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.606623 (+ 222us) server_negotiation.cc:407] Connection header received
0929 22:49:40.607106 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.607106 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.607115 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.607182 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:40.607914 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.608396 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.609310 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.609486 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.609535 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.610257 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:40.610259 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:40.610259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:40.610263 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:40.610276 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:40.610280 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:40.610323 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.610396 (+ 73us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.610421 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 22:49:40.610662 32458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.606313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:44013 (local address 127.12.27.130:58105)
0929 22:49:40.606499 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.606538 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.607026 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.607238 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.607242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.607249 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:40.607839 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.607844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.608472 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.608472 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.609238 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.609240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.609555 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.609556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.609660 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.610138 (+ 478us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:40.610138 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:40.610164 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:40.610184 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:40.610332 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:40.610336 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:40.610338 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.610390 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.610466 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260929 22:49:40.611125 32456 heartbeater.cc:347] Connected to a master server at 127.12.27.190:44013
I20260929 22:49:40.611223 32456 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:40.611397 32456 heartbeater.cc:511] Master 127.12.27.190:44013 requested a full tablet report, sending...
I20260929 22:49:40.611791 32136 ts_manager.cc:194] Registered new tserver with Master: 96a4e64164a14bb9aef1a12b3f5caf8e (127.12.27.130:41881)
I20260929 22:49:40.612123 32136 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.130:58105
I20260929 22:49:40.614848 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 32327
I20260929 22:49:40.614933 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-1/wal/instance
I20260929 22:49:40.615077 12398 external_mini_cluster.cc:1428] Setting key 4cdde34fb3d403605d30a13cde177cb0
I20260929 22:49:40.615898 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.27.131:0
--local_ip_for_outbound_sockets=127.12.27.131
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:44013
--builtin_ntp_servers=127.12.27.148:41327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 22:49:40.695506 32459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:40.695788 32459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:40.695827 32459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:40.696949 32459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:40.697009 32459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:40.697049 32459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.27.131
I20260929 22:49:40.698364 32459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.27.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.27.131
--webserver_port=0
--tserver_master_addrs=127.12.27.190:44013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.27.131
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:40.698629 32459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:40.698920 32459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:40.703913 32464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:40.704100 32465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.704239 32459 server_base.cc:1034] running on GCE node
W20260929 22:49:40.704264 32467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:40.704494 32459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:40.704757 32459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:40.705915 32459 hybrid_clock.cc:648] HybridClock initialized: now 1790722180705899 us; error 35 us; skew 500 ppm
I20260929 22:49:40.707116 32459 webserver.cc:460] Webserver started at http://127.12.27.131:34667/ using document root <none> and password file <none>
I20260929 22:49:40.707365 32459 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:40.707432 32459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:40.707563 32459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:40.708626 32459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data/instance:
uuid: "b88757b3eab94d2c8bec523ca9f1b2ca"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "ed6d3ad6f640cd713b96b352b5659b17"
server_key_iv: "6234e15f6b4336074c5eb2d34e1efc19"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.709075 32459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance:
uuid: "b88757b3eab94d2c8bec523ca9f1b2ca"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "ed6d3ad6f640cd713b96b352b5659b17"
server_key_iv: "6234e15f6b4336074c5eb2d34e1efc19"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.710327 32459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:40.711084 32473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.711268 32459 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:40.711361 32459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal
uuid: "b88757b3eab94d2c8bec523ca9f1b2ca"
format_stamp: "Formatted at 2026-09-29 22:49:40 on dist-test-slave-00d6"
server_key: "ed6d3ad6f640cd713b96b352b5659b17"
server_key_iv: "6234e15f6b4336074c5eb2d34e1efc19"
server_key_version: "encryptionkey@0"
I20260929 22:49:40.711442 32459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:40.731288 32459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:40.731643 32459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:40.731801 32459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:40.732048 32459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 22:49:40.732379 32459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 22:49:40.732430 32459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.732465 32459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 22:49:40.732507 32459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:40.738209 32459 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.131:36825
I20260929 22:49:40.738287 32586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.131:36825 every 8 connection(s)
I20260929 22:49:40.738618 32459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/data/info.pb
I20260929 22:49:40.740327 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 32459
I20260929 22:49:40.740458 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal/instance
I20260929 22:49:40.740674 12398 external_mini_cluster.cc:1428] Setting key c74710fcdc6ae75b11bc99789f4fb13d
I20260929 22:49:40.744218 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.739366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:54407 (local address 127.12.27.190:44013)
0929 22:49:40.739410 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.739412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.739713 (+ 301us) server_negotiation.cc:407] Connection header received
0929 22:49:40.740237 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.740238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.740250 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.740307 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:40.741242 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.741896 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.742863 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.743070 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.743137 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.743987 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:40.743988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:40.743988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:40.743992 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:40.744008 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:40.744012 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:40.744060 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.744135 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.744159 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:49:40.744453 32589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.739332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:44013 (local address 127.12.27.131:54407)
0929 22:49:40.739542 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.739587 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.740132 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.740383 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.740388 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.740398 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:49:40.741050 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.741058 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.741974 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.741975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.742763 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.742765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.743152 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.743153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.743268 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.743856 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 22:49:40.743857 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:49:40.743884 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 22:49:40.743906 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:49:40.744066 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:49:40.744069 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:49:40.744071 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.744123 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.744209 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
I20260929 22:49:40.744956 32587 heartbeater.cc:347] Connected to a master server at 127.12.27.190:44013
I20260929 22:49:40.745045 32587 heartbeater.cc:464] Registering TS with master...
I20260929 22:49:40.745218 32587 heartbeater.cc:511] Master 127.12.27.190:44013 requested a full tablet report, sending...
I20260929 22:49:40.745582 32136 ts_manager.cc:194] Registered new tserver with Master: b88757b3eab94d2c8bec523ca9f1b2ca (127.12.27.131:36825)
I20260929 22:49:40.745929 32136 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.27.131:54407
I20260929 22:49:40.752610 12398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 22:49:40.757102 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.753950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50952 (local address 127.12.27.190:44013)
0929 22:49:40.754013 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.754016 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.754138 (+ 122us) server_negotiation.cc:407] Connection header received
0929 22:49:40.754223 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.754224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.754236 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.754304 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:40.754478 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.754987 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.755864 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.756061 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.756142 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.756830 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:40.756831 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:40.756832 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:40.756836 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:40.756850 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:40.756854 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:40.756918 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.756986 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.757009 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 22:49:40.758529 32136 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 22:49:40.760155 32136 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 22:49:40.766296 32597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.762166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41881 (local address 127.0.0.1:55656)
0929 22:49:40.762349 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.762389 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.762456 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.762881 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.762884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.762886 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.762957 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.762959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.764354 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.764355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.765313 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.765316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.766004 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.766005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.766078 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.766090 (+ 12us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.766165 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.766217 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":7,"thread_start_us":54,"threads_started":1}
I20260929 22:49:40.766307 32599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.762392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55656 (local address 127.12.27.130:41881)
0929 22:49:40.762701 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.762705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.762714 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:40.762751 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.762753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.762769 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.763042 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.763110 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.764241 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.765403 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.765918 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.766005 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.766101 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.766189 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.766228 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":113,"threads_started":1}
I20260929 22:49:40.766422 32596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.762169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.131:36825 (local address 127.0.0.1:54860)
0929 22:49:40.762564 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.762572 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.762609 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.762884 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.762885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.762886 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.762958 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.762960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.764333 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.764334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.765397 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.765399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.766233 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.766234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.766295 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.766297 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.766325 (+ 28us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.766353 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":33,"thread_start_us":102,"threads_started":1}
I20260929 22:49:40.766605 32598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.762245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57322 (local address 127.12.27.129:38599)
0929 22:49:40.762748 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.762753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.762764 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:40.762801 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.762803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.762816 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.762886 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.763095 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.763855 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.765215 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.765957 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.766030 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.766116 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.766469 (+ 353us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.766517 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":106,"threads_started":1}
I20260929 22:49:40.766774 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.762392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54860 (local address 127.12.27.131:36825)
0929 22:49:40.762593 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.762598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.762612 (+ 14us) server_negotiation.cc:407] Connection header received
0929 22:49:40.762685 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.762688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.762704 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.762785 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.763043 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.764241 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.765461 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.766146 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.766533 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.766626 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.766652 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.766696 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260929 22:49:40.766420 32595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.762169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:38599 (local address 127.0.0.1:57322)
0929 22:49:40.762596 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.762607 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.762664 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.762956 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.762957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.762959 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.763016 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.763018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.763933 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.763934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.765129 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.765131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.766157 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.766158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.766225 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.766232 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.766277 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.766324 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":2,"spinlock_wait_cycles":896,"thread_start_us":99,"threads_started":1}
I20260929 22:49:40.767472 32521 tablet_service.cc:1467] Processing CreateTablet for tablet 4901ccd366894441bac52bffff3312a2 (DEFAULT_TABLE table=test-table [id=0dbd746bf5a243af8ea52b53682dff6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:40.767510 32389 tablet_service.cc:1467] Processing CreateTablet for tablet 4901ccd366894441bac52bffff3312a2 (DEFAULT_TABLE table=test-table [id=0dbd746bf5a243af8ea52b53682dff6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:40.767508 32258 tablet_service.cc:1467] Processing CreateTablet for tablet 4901ccd366894441bac52bffff3312a2 (DEFAULT_TABLE table=test-table [id=0dbd746bf5a243af8ea52b53682dff6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 22:49:40.767874 32521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4901ccd366894441bac52bffff3312a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:40.767892 32389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4901ccd366894441bac52bffff3312a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:40.767892 32258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4901ccd366894441bac52bffff3312a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:40.770931 32601 tablet_bootstrap.cc:492] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Bootstrap starting.
I20260929 22:49:40.771376 32602 tablet_bootstrap.cc:492] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: Bootstrap starting.
I20260929 22:49:40.771760 32601 tablet_bootstrap.cc:654] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:40.771804 32603 tablet_bootstrap.cc:492] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: Bootstrap starting.
I20260929 22:49:40.772075 32601 log.cc:824] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:40.772089 32602 tablet_bootstrap.cc:654] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:40.772413 32602 log.cc:824] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:40.772464 32603 tablet_bootstrap.cc:654] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:40.772763 32603 log.cc:824] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:40.772861 32601 tablet_bootstrap.cc:492] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: No bootstrap required, opened a new log
I20260929 22:49:40.772938 32601 ts_tablet_manager.cc:1397] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:49:40.773175 32602 tablet_bootstrap.cc:492] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: No bootstrap required, opened a new log
I20260929 22:49:40.773239 32602 ts_tablet_manager.cc:1397] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 22:49:40.773486 32603 tablet_bootstrap.cc:492] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: No bootstrap required, opened a new log
I20260929 22:49:40.773550 32603 ts_tablet_manager.cc:1397] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 22:49:40.775471 32603 raft_consensus.cc:348] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.775640 32603 raft_consensus.cc:374] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:40.775719 32603 raft_consensus.cc:729] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a4e64164a14bb9aef1a12b3f5caf8e, State: Initialized, Role: FOLLOWER
I20260929 22:49:40.775828 32603 consensus_queue.cc:260] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.775753 32601 raft_consensus.cc:348] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.775903 32601 raft_consensus.cc:374] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:40.775817 32602 raft_consensus.cc:348] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.775938 32602 raft_consensus.cc:374] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:40.775936 32601 raft_consensus.cc:729] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88757b3eab94d2c8bec523ca9f1b2ca, State: Initialized, Role: FOLLOWER
I20260929 22:49:40.775969 32602 raft_consensus.cc:729] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d133fbb4cd4c04acb52e47a61d15a8, State: Initialized, Role: FOLLOWER
I20260929 22:49:40.776072 32603 ts_tablet_manager.cc:1428] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 22:49:40.776078 32602 consensus_queue.cc:260] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.776088 32601 consensus_queue.cc:260] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.776196 32456 heartbeater.cc:503] Master 127.12.27.190:44013 was elected leader, sending a full tablet report...
I20260929 22:49:40.776342 32601 ts_tablet_manager.cc:1428] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 22:49:40.776342 32602 ts_tablet_manager.cc:1428] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 22:49:40.776458 32324 heartbeater.cc:503] Master 127.12.27.190:44013 was elected leader, sending a full tablet report...
I20260929 22:49:40.776567 32587 heartbeater.cc:503] Master 127.12.27.190:44013 was elected leader, sending a full tablet report...
I20260929 22:49:40.820075 32608 raft_consensus.cc:482] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 22:49:40.820233 32608 raft_consensus.cc:504] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.820574 32608 leader_election.cc:288] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95d133fbb4cd4c04acb52e47a61d15a8 (127.12.27.129:38599), 96a4e64164a14bb9aef1a12b3f5caf8e (127.12.27.130:41881)
I20260929 22:49:40.823370 32598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.820840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:52597 (local address 127.12.27.129:38599)
0929 22:49:40.820895 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.820898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.820909 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:49:40.820945 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.820946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.820959 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.821021 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.821218 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.821691 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.822615 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.823011 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.823093 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.823102 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.823260 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.823297 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 22:49:40.823370 32589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.820743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:38599 (local address 127.12.27.131:52597)
0929 22:49:40.820787 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.820799 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.820838 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.821079 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.821080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.821082 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.821157 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.821159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.821789 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.821790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.822517 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.822518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.823101 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.823102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.823178 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.823181 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.823251 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.823297 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260929 22:49:40.823450 32599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.820926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.27.131:44759 (local address 127.12.27.130:41881)
0929 22:49:40.820991 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.820993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.821096 (+ 103us) server_negotiation.cc:407] Connection header received
0929 22:49:40.821168 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.821169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.821187 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.821253 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 22:49:40.821399 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.821850 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.822739 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.823098 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.823186 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.823193 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.823339 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.823379 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 22:49:40.823487 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.820752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41881 (local address 127.12.27.131:44759)
0929 22:49:40.821029 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.821040 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:49:40.821104 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:49:40.821258 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:49:40.821258 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:49:40.821260 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 22:49:40.821326 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.821328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.821926 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.821927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.822644 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:49:40.822646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.823176 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.823177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:49:40.823253 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.823256 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 22:49:40.823331 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 22:49:40.823366 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":131,"thread_start_us":94,"threads_started":1}
I20260929 22:49:40.823894 32409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4901ccd366894441bac52bffff3312a2" candidate_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" is_pre_election: true
I20260929 22:49:40.824036 32409 raft_consensus.cc:2454] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88757b3eab94d2c8bec523ca9f1b2ca in term 0.
I20260929 22:49:40.824236 32476 leader_election.cc:302] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a4e64164a14bb9aef1a12b3f5caf8e, b88757b3eab94d2c8bec523ca9f1b2ca; no voters:
I20260929 22:49:40.824249 32278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4901ccd366894441bac52bffff3312a2" candidate_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" is_pre_election: true
I20260929 22:49:40.824378 32278 raft_consensus.cc:2454] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88757b3eab94d2c8bec523ca9f1b2ca in term 0.
I20260929 22:49:40.824373 32608 raft_consensus.cc:2781] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 22:49:40.824462 32608 raft_consensus.cc:482] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 22:49:40.824496 32608 raft_consensus.cc:3037] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.825322 32608 raft_consensus.cc:504] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.825467 32608 leader_election.cc:288] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [CANDIDATE]: Term 1 election: Requested vote from peers 95d133fbb4cd4c04acb52e47a61d15a8 (127.12.27.129:38599), 96a4e64164a14bb9aef1a12b3f5caf8e (127.12.27.130:41881)
I20260929 22:49:40.825614 32278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4901ccd366894441bac52bffff3312a2" candidate_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95d133fbb4cd4c04acb52e47a61d15a8"
I20260929 22:49:40.825628 32409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4901ccd366894441bac52bffff3312a2" candidate_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e"
I20260929 22:49:40.825697 32409 raft_consensus.cc:3037] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.825697 32278 raft_consensus.cc:3037] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:40.826606 32409 raft_consensus.cc:2454] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88757b3eab94d2c8bec523ca9f1b2ca in term 1.
I20260929 22:49:40.826606 32278 raft_consensus.cc:2454] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88757b3eab94d2c8bec523ca9f1b2ca in term 1.
I20260929 22:49:40.826799 32475 leader_election.cc:302] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95d133fbb4cd4c04acb52e47a61d15a8, b88757b3eab94d2c8bec523ca9f1b2ca; no voters:
I20260929 22:49:40.826905 32608 raft_consensus.cc:2781] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:40.827026 32608 raft_consensus.cc:686] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 1 LEADER]: Becoming Leader. State: Replica: b88757b3eab94d2c8bec523ca9f1b2ca, State: Running, Role: LEADER
I20260929 22:49:40.827097 32608 consensus_queue.cc:237] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } }
I20260929 22:49:40.827913 32136 catalog_manager.cc:5495] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b88757b3eab94d2c8bec523ca9f1b2ca (127.12.27.131). New cstate: current_term: 1 leader_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b88757b3eab94d2c8bec523ca9f1b2ca" member_type: VOTER last_known_addr { host: "127.12.27.131" port: 36825 } health_report { overall_health: HEALTHY } } }
I20260929 22:49:40.837952 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.835956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54876 (local address 127.12.27.131:36825)
0929 22:49:40.835994 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:40.835995 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:40.836004 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:40.836074 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:40.836075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:40.836089 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:40.836149 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:49:40.836249 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.836700 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.837354 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:40.837527 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:40.837576 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:40.837688 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:49:40.837780 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:49:40.837840 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:40.837859 (+ 19us) server_negotiation.cc:299] Negotiation successful
0929 22:49:40.837873 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:49:40.840052 32278 raft_consensus.cc:1261] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 1 FOLLOWER]: Refusing update from remote peer b88757b3eab94d2c8bec523ca9f1b2ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:40.840065 32409 raft_consensus.cc:1261] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 1 FOLLOWER]: Refusing update from remote peer b88757b3eab94d2c8bec523ca9f1b2ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:49:40.840370 32608 consensus_queue.cc:1035] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "95d133fbb4cd4c04acb52e47a61d15a8" member_type: VOTER last_known_addr { host: "127.12.27.129" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:40.840519 32611 consensus_queue.cc:1035] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "96a4e64164a14bb9aef1a12b3f5caf8e" member_type: VOTER last_known_addr { host: "127.12.27.130" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:49:40.843096 32616 mvcc.cc:205] Tried to move back new op lower bound from 7334798052718129152 to 7334798052668477440. Current Snapshot: MvccSnapshot[applied={T|T < 7334798052718129152}]
I20260929 22:49:40.844012 32615 mvcc.cc:205] Tried to move back new op lower bound from 7334798052718129152 to 7334798052668477440. Current Snapshot: MvccSnapshot[applied={T|T < 7334798052718129152 or (T in {7334798052718129152})}]
I20260929 22:49:40.845209 32134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:40.845304 32134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 22:49:40.846055 32134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 389528ee376046168905b28ebfa268e5: Sending DeleteTablet for 3 replicas of tablet 4901ccd366894441bac52bffff3312a2
I20260929 22:49:40.846410 32258 tablet_service.cc:1514] Processing DeleteTablet for tablet 4901ccd366894441bac52bffff3312a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:40 UTC) from {username='slave'} at 127.0.0.1:57322
I20260929 22:49:40.846426 32389 tablet_service.cc:1514] Processing DeleteTablet for tablet 4901ccd366894441bac52bffff3312a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:40 UTC) from {username='slave'} at 127.0.0.1:55656
I20260929 22:49:40.846632 32623 tablet_replica.cc:330] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: stopping tablet replica
I20260929 22:49:40.846621 32521 tablet_service.cc:1514] Processing DeleteTablet for tablet 4901ccd366894441bac52bffff3312a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 22:49:40 UTC) from {username='slave'} at 127.0.0.1:54860
I20260929 22:49:40.846738 32623 raft_consensus.cc:2229] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:40.846858 32625 tablet_replica.cc:330] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: stopping tablet replica
I20260929 22:49:40.846897 32624 tablet_replica.cc:330] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8: stopping tablet replica
I20260929 22:49:40.847000 32624 raft_consensus.cc:2229] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 22:49:40.847059 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 32196
I20260929 22:49:40.847110 32624 raft_consensus.cc:2258] T 4901ccd366894441bac52bffff3312a2 P 95d133fbb4cd4c04acb52e47a61d15a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:40.847033 32625 raft_consensus.cc:2229] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 1 LEADER]: Raft consensus shutting down.
I20260929 22:49:40.847985 32625 raft_consensus.cc:2258] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:40.848446 32625 ts_tablet_manager.cc:1905] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 22:49:40.850169 32625 ts_tablet_manager.cc:1918] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 22:49:40.850294 32625 log.cc:1196] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Deleting WAL directory at /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790721915685765-12398-0/minicluster-data/ts-2/wal/wals/4901ccd366894441bac52bffff3312a2
I20260929 22:49:40.850620 32625 ts_tablet_manager.cc:1939] T 4901ccd366894441bac52bffff3312a2 P b88757b3eab94d2c8bec523ca9f1b2ca: Deleting consensus metadata
I20260929 22:49:40.851115 32120 catalog_manager.cc:4841] TS b88757b3eab94d2c8bec523ca9f1b2ca (127.12.27.131:36825): tablet 4901ccd366894441bac52bffff3312a2 (table test-table [id=0dbd746bf5a243af8ea52b53682dff6f]) successfully deleted
I20260929 22:49:40.852288 32623 raft_consensus.cc:2258] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 22:49:40.852759 32623 ts_tablet_manager.cc:1905] T 4901ccd366894441bac52bffff3312a2 P 96a4e64164a14bb9aef1a12b3f5caf8e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 22:49:40.852936 32121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.27.129:38599 (error 108)
I20260929 22:49:40.853358 32595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.853240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.129:38599 (local address 127.0.0.1:57324)
0929 22:49:40.853290 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.853326 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.129:38599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:49:40.853473 32121 catalog_manager.cc:4584] TS 95d133fbb4cd4c04acb52e47a61d15a8 (127.12.27.129:38599): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4901ccd366894441bac52bffff3312a2: Network error: Client connection negotiation failed: client connection to 127.12.27.129:38599: connect: Connection refused (error 111)
I20260929 22:49:40.853647 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 32327
I20260929 22:49:40.859913 32595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:40.859746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.130:41881 (local address 127.0.0.1:55658)
0929 22:49:40.859845 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0929 22:49:40.859872 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.130:41881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260929 22:49:40.859978 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 32459
I20260929 22:49:40.864441 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 32105
2026-09-29T22:49:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (704 ms)
[----------] 6 tests from EncryptionPolicyTest (8252 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:40 dist-test-slave-00d6 krb5kdc[32629](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:40 dist-test-slave-00d6 krb5kdc[32629](info): set up 2 sockets
Sep 29 22:49:40 dist-test-slave-00d6 krb5kdc[32629](info): commencing operation
krb5kdc: starting...
W20260929 22:49:41.900100 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:41 dist-test-slave-00d6 krb5kdc[32629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:42.018009 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:42.100471 32642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:42.100698 32642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:42.100723 32642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:42.101899 32642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:42.101976 32642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:42.102000 32642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:42.102023 32642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:42.102053 32642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:42.104387 32642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36711
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:42.104687 32642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:42.104868 32642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:42.109596 32648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:42.109637 32647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:42.109611 32650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:42.109946 32642 server_base.cc:1034] running on GCE node
I20260929 22:49:42.110203 32642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:42.110495 32642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:42.111698 32642 hybrid_clock.cc:648] HybridClock initialized: now 1790722182111677 us; error 28 us; skew 500 ppm
Sep 29 22:49:42 dist-test-slave-00d6 krb5kdc[32629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722182, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:42.114336 32642 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:42.114761 32642 webserver.cc:460] Webserver started at http://127.0.0.1:35113/ using document root <none> and password file <none>
I20260929 22:49:42.114986 32642 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:42.115064 32642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:42.115203 32642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:42.116314 32642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "9580ca1088824d01b8e70d38d52b6417"
format_stamp: "Formatted at 2026-09-29 22:49:42 on dist-test-slave-00d6"
server_key: "dc09ac6d4dea2fc126e55a71d3bbef17"
server_key_iv: "0f428be5e234e35eee6e77522c6a54b7"
server_key_version: "encryptionkey@0"
I20260929 22:49:42.116672 32642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "9580ca1088824d01b8e70d38d52b6417"
format_stamp: "Formatted at 2026-09-29 22:49:42 on dist-test-slave-00d6"
server_key: "dc09ac6d4dea2fc126e55a71d3bbef17"
server_key_iv: "0f428be5e234e35eee6e77522c6a54b7"
server_key_version: "encryptionkey@0"
I20260929 22:49:42.118040 32642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:49:42.118747 32657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:42.118932 32642 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:42.119035 32642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "9580ca1088824d01b8e70d38d52b6417"
format_stamp: "Formatted at 2026-09-29 22:49:42 on dist-test-slave-00d6"
server_key: "dc09ac6d4dea2fc126e55a71d3bbef17"
server_key_iv: "0f428be5e234e35eee6e77522c6a54b7"
server_key_version: "encryptionkey@0"
I20260929 22:49:42.119107 32642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:42.141094 32642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:42.143033 32642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:42.143193 32642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:42.147054 32642 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36711
I20260929 22:49:42.147104 32709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36711 every 8 connection(s)
I20260929 22:49:42.147452 32642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:42.148358 32710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:42.150566 32710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417: Bootstrap starting.
I20260929 22:49:42.151093 32710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:42.151322 32710 log.cc:824] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:42.152020 32710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417: No bootstrap required, opened a new log
I20260929 22:49:42.152840 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 32642
I20260929 22:49:42.152952 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:42.153149 12398 external_mini_cluster.cc:1428] Setting key f623864767c005eb0ccf705bf991c53d
I20260929 22:49:42.154181 32710 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9580ca1088824d01b8e70d38d52b6417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36711 } }
I20260929 22:49:42.154342 32710 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:42.154381 32710 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9580ca1088824d01b8e70d38d52b6417, State: Initialized, Role: FOLLOWER
I20260929 22:49:42.154523 32710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9580ca1088824d01b8e70d38d52b6417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36711 } }
I20260929 22:49:42.154608 32710 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:42.154640 32710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:42.154693 32710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:42.155728 32710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9580ca1088824d01b8e70d38d52b6417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36711 } }
I20260929 22:49:42.155815 32710 leader_election.cc:302] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9580ca1088824d01b8e70d38d52b6417; no voters:
I20260929 22:49:42.155982 32710 leader_election.cc:288] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:42.156016 32715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:42.156140 32715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [term 1 LEADER]: Becoming Leader. State: Replica: 9580ca1088824d01b8e70d38d52b6417, State: Running, Role: LEADER
I20260929 22:49:42.156247 32710 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:42.156221 32715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9580ca1088824d01b8e70d38d52b6417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36711 } }
I20260929 22:49:42.156567 32716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9580ca1088824d01b8e70d38d52b6417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9580ca1088824d01b8e70d38d52b6417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36711 } } }
I20260929 22:49:42.156638 32716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:42.156896 32717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9580ca1088824d01b8e70d38d52b6417. Latest consensus state: current_term: 1 leader_uuid: "9580ca1088824d01b8e70d38d52b6417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9580ca1088824d01b8e70d38d52b6417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36711 } } }
I20260929 22:49:42.157027 32717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:42.157177 32720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:42.157639 32720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:42.159142 32720 catalog_manager.cc:1347] Generated new cluster ID: 50ac3c053554464aab3be527eed51269
I20260929 22:49:42.159199 32720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:49:42 dist-test-slave-00d6 krb5kdc[32629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:49:42.165262 32714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:42.153689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56637 (local address 127.0.0.1:36711)
0929 22:49:42.153870 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:42.153878 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:42.153903 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:49:42.154153 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:42.154159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:42.154203 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:42.154319 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:42.155111 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:42.156263 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:42.157409 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:42.158057 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:42.158173 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:42.161034 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:42.161038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:42.161038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:42.161059 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:42.163031 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:42.163514 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:42.163517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:42.163517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:42.163674 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:42.163941 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:42.163941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:42.163942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:42.164251 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:42.164762 (+ 511us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:42.164851 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 22:49:42.164956 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
I20260929 22:49:42.166432 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:42.177459 32720 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:42.178013 32720 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:42.180537 32720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9580ca1088824d01b8e70d38d52b6417: Generated new TSK 0
I20260929 22:49:42.180704 32720 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:42.185206 32714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:42.177175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49823 (local address 127.0.0.1:36711)
0929 22:49:42.177219 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:42.177221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:42.177345 (+ 124us) server_negotiation.cc:407] Connection header received
0929 22:49:42.177451 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:42.177452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:42.177462 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:42.177496 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:42.178932 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:42.179709 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:42.180812 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:42.181157 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:42.181206 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:42.182685 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:42.182686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:42.182687 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:42.182693 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:42.184119 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:42.184523 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:42.184524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:42.184524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:42.184572 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:42.184791 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:42.184791 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:42.184792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:42.184885 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:42.184957 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:42.185103 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:49:42.185151 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:49:42.187299 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 32642
W20260929 22:49:42.191442 32627 connection.cc:535] client connection to 127.0.0.1:36711 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36711): Connection reset by peer (error 104)
2026-09-29T22:49:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1321 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:42 dist-test-slave-00d6 krb5kdc[32741](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:42 dist-test-slave-00d6 krb5kdc[32741](info): set up 2 sockets
Sep 29 22:49:42 dist-test-slave-00d6 krb5kdc[32741](info): commencing operation
krb5kdc: starting...
W20260929 22:49:43.224061 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:43 dist-test-slave-00d6 krb5kdc[32741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:43.342278 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38813
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:43.420250 32754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:43.420482 32754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:43.420521 32754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:43.421644 32754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:43.421716 32754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:43.421741 32754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:43.421767 32754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:43.421790 32754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:43.423245 32754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38813
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:43.423498 32754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:43.423733 32754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:43.428375 32762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:43.428390 32759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:43.428375 32760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:43.428828 32754 server_base.cc:1034] running on GCE node
I20260929 22:49:43.429013 32754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:43.429234 32754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:43.430367 32754 hybrid_clock.cc:648] HybridClock initialized: now 1790722183430354 us; error 28 us; skew 500 ppm
Sep 29 22:49:43 dist-test-slave-00d6 krb5kdc[32741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:43.433061 32754 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:43.433463 32754 webserver.cc:460] Webserver started at http://127.0.0.1:36311/ using document root <none> and password file <none>
I20260929 22:49:43.433687 32754 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:43.433753 32754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:43.433892 32754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:43.435245 32754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "833aa758edc045d5b19b7bf5961d1b99"
format_stamp: "Formatted at 2026-09-29 22:49:43 on dist-test-slave-00d6"
server_key: "88717e94ef7eecb262c2d04b501bba85"
server_key_iv: "ef19489b333816fd95df6b204119663b"
server_key_version: "encryptionkey@0"
I20260929 22:49:43.435673 32754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "833aa758edc045d5b19b7bf5961d1b99"
format_stamp: "Formatted at 2026-09-29 22:49:43 on dist-test-slave-00d6"
server_key: "88717e94ef7eecb262c2d04b501bba85"
server_key_iv: "ef19489b333816fd95df6b204119663b"
server_key_version: "encryptionkey@0"
I20260929 22:49:43.436972 32754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:43.437641 301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:43.437806 32754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:43.437896 32754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "833aa758edc045d5b19b7bf5961d1b99"
format_stamp: "Formatted at 2026-09-29 22:49:43 on dist-test-slave-00d6"
server_key: "88717e94ef7eecb262c2d04b501bba85"
server_key_iv: "ef19489b333816fd95df6b204119663b"
server_key_version: "encryptionkey@0"
I20260929 22:49:43.437981 32754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:43.451030 32754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:43.452862 32754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:43.453013 32754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:43.456811 32754 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38813
I20260929 22:49:43.456848 353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38813 every 8 connection(s)
I20260929 22:49:43.457190 32754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:43.458026 354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:43.460255 354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99: Bootstrap starting.
I20260929 22:49:43.460777 354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:43.461010 354 log.cc:824] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:43.461642 354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99: No bootstrap required, opened a new log
I20260929 22:49:43.463131 354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833aa758edc045d5b19b7bf5961d1b99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38813 } }
I20260929 22:49:43.463284 354 raft_consensus.cc:374] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:43.463307 354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833aa758edc045d5b19b7bf5961d1b99, State: Initialized, Role: FOLLOWER
I20260929 22:49:43.463449 354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833aa758edc045d5b19b7bf5961d1b99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38813 } }
I20260929 22:49:43.463531 354 raft_consensus.cc:388] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:43.463554 354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:43.463588 354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:43.464109 354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833aa758edc045d5b19b7bf5961d1b99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38813 } }
I20260929 22:49:43.464193 354 leader_election.cc:302] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 833aa758edc045d5b19b7bf5961d1b99; no voters:
I20260929 22:49:43.464318 354 leader_election.cc:288] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:43.464375 357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:43.464534 357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [term 1 LEADER]: Becoming Leader. State: Replica: 833aa758edc045d5b19b7bf5961d1b99, State: Running, Role: LEADER
I20260929 22:49:43.464562 354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:43.464623 357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833aa758edc045d5b19b7bf5961d1b99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38813 } }
I20260929 22:49:43.465040 358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "833aa758edc045d5b19b7bf5961d1b99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833aa758edc045d5b19b7bf5961d1b99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38813 } } }
I20260929 22:49:43.465126 358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:43.465181 359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 833aa758edc045d5b19b7bf5961d1b99. Latest consensus state: current_term: 1 leader_uuid: "833aa758edc045d5b19b7bf5961d1b99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "833aa758edc045d5b19b7bf5961d1b99" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38813 } } }
I20260929 22:49:43.465277 359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:43.465370 366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:43.465902 366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:43.466799 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 32754
I20260929 22:49:43.466920 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:43.467123 12398 external_mini_cluster.cc:1428] Setting key a25b54bec554c69848e8fa617a3190af
I20260929 22:49:43.467402 366 catalog_manager.cc:1347] Generated new cluster ID: ed02a27612504633af47da0d960cf165
I20260929 22:49:43.467454 366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:43.477021 377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:43.467560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52263 (local address 127.0.0.1:38813)
0929 22:49:43.471759 (+ 4199us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:43.471768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:43.471800 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:49:43.471906 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:43.471912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:43.471963 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:43.472102 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:43.472428 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:43.473799 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:43.474914 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:43.475483 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:43.475574 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:43.476343 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:43.476347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:43.476347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:43.476551 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:43.476585 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:43.476598 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:43.476682 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:43.476785 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 22:49:43.476811 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4146,"thread_start_us":97,"threads_started":1}
I20260929 22:49:43.477948 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:43.483094 366 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:43.483106 377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:43.479454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52387 (local address 127.0.0.1:38813)
0929 22:49:43.479492 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:43.479494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:43.479686 (+ 192us) server_negotiation.cc:407] Connection header received
0929 22:49:43.479728 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:43.479729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:43.479739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:43.479789 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:43.479929 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:43.480635 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:43.481687 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:43.482014 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:43.482075 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:43.482793 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:43.482794 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:43.482795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:43.482799 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:43.482813 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:43.482817 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:43.482850 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:43.483006 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 22:49:43.483026 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:49:43.483750 366 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:43.486820 366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 833aa758edc045d5b19b7bf5961d1b99: Generated new TSK 0
I20260929 22:49:43.486989 366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:43.489627 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 32754
W20260929 22:49:43.493880 32739 connection.cc:535] client connection to 127.0.0.1:38813 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38813): Connection reset by peer (error 104)
2026-09-29T22:49:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1302 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:43 dist-test-slave-00d6 krb5kdc[385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:43 dist-test-slave-00d6 krb5kdc[385](info): set up 2 sockets
Sep 29 22:49:43 dist-test-slave-00d6 krb5kdc[385](info): commencing operation
krb5kdc: starting...
W20260929 22:49:44.532187 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:44 dist-test-slave-00d6 krb5kdc[385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:44.650549 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32867
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:44.731794 398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:44.731988 398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:44.732028 398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:44.733217 398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:44.733260 398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:44.733274 398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:44.733287 398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:44.733299 398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:44.734705 398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32867
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:44.734892 398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:44.735057 398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 22:49:44.739899 398 server_base.cc:1034] running on GCE node
W20260929 22:49:44.739847 404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:44.739871 406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:44.739846 403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:44.740237 398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:44.740478 398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:44.741616 398 hybrid_clock.cc:648] HybridClock initialized: now 1790722184741605 us; error 28 us; skew 500 ppm
Sep 29 22:49:44 dist-test-slave-00d6 krb5kdc[385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722184, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:44.744093 398 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:44.744570 398 webserver.cc:460] Webserver started at http://127.0.0.1:33727/ using document root <none> and password file <none>
I20260929 22:49:44.744800 398 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:44.744864 398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:44.745007 398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:44.746026 398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "ca11ad71029b4951a79e14e9ce1bbd4a"
format_stamp: "Formatted at 2026-09-29 22:49:44 on dist-test-slave-00d6"
server_key: "715046a00f8aae8aad31f30d37aca42c"
server_key_iv: "1e2230e723b47ed25a582590c1a6dd77"
server_key_version: "encryptionkey@0"
I20260929 22:49:44.746378 398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "ca11ad71029b4951a79e14e9ce1bbd4a"
format_stamp: "Formatted at 2026-09-29 22:49:44 on dist-test-slave-00d6"
server_key: "715046a00f8aae8aad31f30d37aca42c"
server_key_iv: "1e2230e723b47ed25a582590c1a6dd77"
server_key_version: "encryptionkey@0"
I20260929 22:49:44.747710 398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:49:44.748391 413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:44.748544 398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:44.748636 398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "ca11ad71029b4951a79e14e9ce1bbd4a"
format_stamp: "Formatted at 2026-09-29 22:49:44 on dist-test-slave-00d6"
server_key: "715046a00f8aae8aad31f30d37aca42c"
server_key_iv: "1e2230e723b47ed25a582590c1a6dd77"
server_key_version: "encryptionkey@0"
I20260929 22:49:44.748714 398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:44.751904 398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:44.753875 398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:44.754027 398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:44.757827 398 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32867
I20260929 22:49:44.757859 465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32867 every 8 connection(s)
I20260929 22:49:44.758183 398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:44.758993 466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:44.761276 466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a: Bootstrap starting.
I20260929 22:49:44.761835 466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:44.762106 466 log.cc:824] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:44.762756 466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a: No bootstrap required, opened a new log
I20260929 22:49:44.764415 466 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32867 } }
I20260929 22:49:44.764549 466 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:44.764590 466 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca11ad71029b4951a79e14e9ce1bbd4a, State: Initialized, Role: FOLLOWER
I20260929 22:49:44.764755 466 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32867 } }
I20260929 22:49:44.764853 466 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:44.764889 466 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:44.764891 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 398
I20260929 22:49:44.764941 466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:44.765012 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:44.765208 12398 external_mini_cluster.cc:1428] Setting key 5b7a6c8a25a084a0871bd9271d868e06
I20260929 22:49:44.765625 466 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32867 } }
I20260929 22:49:44.765805 466 leader_election.cc:302] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca11ad71029b4951a79e14e9ce1bbd4a; no voters:
I20260929 22:49:44.765980 466 leader_election.cc:288] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:44.766003 471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:44.766108 471 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [term 1 LEADER]: Becoming Leader. State: Replica: ca11ad71029b4951a79e14e9ce1bbd4a, State: Running, Role: LEADER
I20260929 22:49:44.766242 471 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32867 } }
I20260929 22:49:44.766251 466 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:44.767493 470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:44.765667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33435 (local address 127.0.0.1:32867)
0929 22:49:44.765834 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:44.765844 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:44.765923 (+ 79us) server_negotiation.cc:407] Connection header received
0929 22:49:44.766046 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:44.766053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:44.766085 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:44.766478 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:44.766974 (+ 496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:44.766977 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:44.766978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:44.766982 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:44.767025 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:44.767038 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:44.767114 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:44.767222 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 22:49:44.767270 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260929 22:49:44.767549 472 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca11ad71029b4951a79e14e9ce1bbd4a. Latest consensus state: current_term: 1 leader_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32867 } } }
I20260929 22:49:44.767778 472 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:44.767987 481 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:44.767513 473 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca11ad71029b4951a79e14e9ce1bbd4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32867 } } }
I20260929 22:49:44.768116 473 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:44.768577 481 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:44.768662 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:44.771211 470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:44.770256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60633 (local address 127.0.0.1:32867)
0929 22:49:44.770287 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:44.770289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:44.770413 (+ 124us) server_negotiation.cc:407] Connection header received
0929 22:49:44.770472 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:44.770473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:44.770477 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:44.770519 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:44.771026 (+ 507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:44.771027 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:44.771027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:44.771030 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:44.771042 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:44.771045 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:44.771084 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:44.771161 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 22:49:44.771172 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:49:44.772028 481 catalog_manager.cc:1347] Generated new cluster ID: 43fb21ad2df445fbbd24de9bd08b4bad
I20260929 22:49:44.772083 481 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:44.802537 481 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:44.802769 481 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:44.805788 481 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca11ad71029b4951a79e14e9ce1bbd4a: Generated new TSK 0
I20260929 22:49:44.805979 481 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:44.812578 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 398
2026-09-29T22:49:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:44 dist-test-slave-00d6 krb5kdc[497](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:44 dist-test-slave-00d6 krb5kdc[497](info): set up 2 sockets
Sep 29 22:49:44 dist-test-slave-00d6 krb5kdc[497](info): commencing operation
krb5kdc: starting...
W20260929 22:49:45.840088 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:45 dist-test-slave-00d6 krb5kdc[497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:45.958209 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43435
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:46.039027 510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:46.039247 510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:46.039287 510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:46.040486 510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:46.040551 510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:46.040578 510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:46.040607 510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:46.040632 510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:46.042107 510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:46.042372 510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:46.042591 510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:46.047382 515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:46.047499 516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:46.047385 518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:46.047675 510 server_base.cc:1034] running on GCE node
I20260929 22:49:46.047914 510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:46.048200 510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:46.049355 510 hybrid_clock.cc:648] HybridClock initialized: now 1790722186049349 us; error 34 us; skew 500 ppm
Sep 29 22:49:46 dist-test-slave-00d6 krb5kdc[497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722186, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:46.051838 510 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:46.052241 510 webserver.cc:460] Webserver started at http://127.0.0.1:36515/ using document root <none> and password file <none>
I20260929 22:49:46.052479 510 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:46.052543 510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:46.052685 510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:46.053697 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "21b378e631af44efbab1e6c4289a8288"
format_stamp: "Formatted at 2026-09-29 22:49:46 on dist-test-slave-00d6"
server_key: "f5c66a93fbf656e5405eed470fd53e4f"
server_key_iv: "280c988d62b2824320920245e4d731f2"
server_key_version: "encryptionkey@0"
I20260929 22:49:46.054040 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "21b378e631af44efbab1e6c4289a8288"
format_stamp: "Formatted at 2026-09-29 22:49:46 on dist-test-slave-00d6"
server_key: "f5c66a93fbf656e5405eed470fd53e4f"
server_key_iv: "280c988d62b2824320920245e4d731f2"
server_key_version: "encryptionkey@0"
I20260929 22:49:46.055296 510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:46.056033 525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:46.056198 510 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:46.056293 510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "21b378e631af44efbab1e6c4289a8288"
format_stamp: "Formatted at 2026-09-29 22:49:46 on dist-test-slave-00d6"
server_key: "f5c66a93fbf656e5405eed470fd53e4f"
server_key_iv: "280c988d62b2824320920245e4d731f2"
server_key_version: "encryptionkey@0"
I20260929 22:49:46.056360 510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:46.069186 510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:46.071400 510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:46.071551 510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:46.075209 510 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43435
I20260929 22:49:46.075265 577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43435 every 8 connection(s)
I20260929 22:49:46.075595 510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:46.076416 578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:46.078595 578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288: Bootstrap starting.
I20260929 22:49:46.079164 578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:46.079449 578 log.cc:824] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:46.080161 578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288: No bootstrap required, opened a new log
I20260929 22:49:46.081769 578 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b378e631af44efbab1e6c4289a8288" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43435 } }
I20260929 22:49:46.081907 578 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:46.081928 578 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b378e631af44efbab1e6c4289a8288, State: Initialized, Role: FOLLOWER
I20260929 22:49:46.082095 578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b378e631af44efbab1e6c4289a8288" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43435 } }
I20260929 22:49:46.082173 578 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:46.082222 578 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:46.082274 578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:46.082742 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 510
I20260929 22:49:46.082852 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:46.082852 578 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b378e631af44efbab1e6c4289a8288" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43435 } }
I20260929 22:49:46.082983 578 leader_election.cc:302] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21b378e631af44efbab1e6c4289a8288; no voters:
I20260929 22:49:46.083071 12398 external_mini_cluster.cc:1428] Setting key dfec40b9d1dc7ccf6a74c76d25ff1465
I20260929 22:49:46.083156 578 leader_election.cc:288] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:46.083192 581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:46.083372 581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [term 1 LEADER]: Becoming Leader. State: Replica: 21b378e631af44efbab1e6c4289a8288, State: Running, Role: LEADER
I20260929 22:49:46.083421 578 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:46.083547 581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b378e631af44efbab1e6c4289a8288" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43435 } }
I20260929 22:49:46.084295 583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21b378e631af44efbab1e6c4289a8288" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b378e631af44efbab1e6c4289a8288" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43435 } } }
I20260929 22:49:46.084380 583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:46.084791 593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:46.084848 582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21b378e631af44efbab1e6c4289a8288. Latest consensus state: current_term: 1 leader_uuid: "21b378e631af44efbab1e6c4289a8288" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b378e631af44efbab1e6c4289a8288" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43435 } } }
I20260929 22:49:46.085008 582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:46.085438 593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:46.087112 593 catalog_manager.cc:1347] Generated new cluster ID: 4187fba0be6c40c08f958c183d993edc
I20260929 22:49:46.087167 593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:49:46 dist-test-slave-00d6 krb5kdc[497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:49:46.094677 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:46.083765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58649 (local address 127.0.0.1:43435)
0929 22:49:46.083922 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:46.083932 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:46.083987 (+ 55us) server_negotiation.cc:407] Connection header received
0929 22:49:46.084107 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:46.084115 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:46.084187 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:46.085215 (+ 1028us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:46.085311 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:46.086479 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:46.087423 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:46.088094 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:46.088209 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:46.090968 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:46.090972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:46.090972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:46.090983 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:46.092969 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:46.093375 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:46.093378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:46.093378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:46.093485 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:46.093695 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:46.093696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:46.093696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:46.093982 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:46.094137 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:46.094250 (+ 113us) server_negotiation.cc:299] Negotiation successful
0929 22:49:46.094372 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260929 22:49:46.095522 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:46.103988 593 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:46.104485 593 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:46.107829 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:46.096930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48805 (local address 127.0.0.1:43435)
0929 22:49:46.096961 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:46.096963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:46.097195 (+ 232us) server_negotiation.cc:407] Connection header received
0929 22:49:46.097260 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:46.097260 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:46.097269 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:46.097320 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:46.097924 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:46.098645 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:46.099702 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:46.099988 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:46.100047 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:46.101420 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:46.101421 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:46.101421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:46.101427 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:46.102960 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:46.103350 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:46.103352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:46.103352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:46.103412 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:46.103621 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:46.103622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:46.103622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:46.103787 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:46.103880 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:46.107543 (+ 3663us) server_negotiation.cc:299] Negotiation successful
0929 22:49:46.107738 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 22:49:46.107888 593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21b378e631af44efbab1e6c4289a8288: Generated new TSK 0
I20260929 22:49:46.108135 593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:46.109968 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 510
2026-09-29T22:49:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1296 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:46 dist-test-slave-00d6 krb5kdc[609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:46 dist-test-slave-00d6 krb5kdc[609](info): set up 2 sockets
Sep 29 22:49:46 dist-test-slave-00d6 krb5kdc[609](info): commencing operation
krb5kdc: starting...
W20260929 22:49:47.136117 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:47 dist-test-slave-00d6 krb5kdc[609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:47.250787 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36663
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:47.333673 622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:47.333863 622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:47.333886 622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:47.335156 622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:47.335198 622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:47.335213 622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:47.335227 622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:47.335239 622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:47.337193 622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:47.337433 622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:47.337669 622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:47.342566 627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:47.342629 622 server_base.cc:1034] running on GCE node
W20260929 22:49:47.342801 630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:47.342542 628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:47.343118 622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:47.343405 622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:47.344561 622 hybrid_clock.cc:648] HybridClock initialized: now 1790722187344549 us; error 31 us; skew 500 ppm
Sep 29 22:49:47 dist-test-slave-00d6 krb5kdc[609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:47.347266 622 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:47.347816 622 webserver.cc:460] Webserver started at http://127.0.0.1:44829/ using document root <none> and password file <none>
I20260929 22:49:47.348090 622 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:47.348165 622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:47.348302 622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:47.349748 622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "d4caa199b2cc4d51b50643267084547d"
format_stamp: "Formatted at 2026-09-29 22:49:47 on dist-test-slave-00d6"
server_key: "95b8d807040ccc46ca660bd890c52ce6"
server_key_iv: "bb871243e20981299939788a0489d4f9"
server_key_version: "encryptionkey@0"
I20260929 22:49:47.350176 622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "d4caa199b2cc4d51b50643267084547d"
format_stamp: "Formatted at 2026-09-29 22:49:47 on dist-test-slave-00d6"
server_key: "95b8d807040ccc46ca660bd890c52ce6"
server_key_iv: "bb871243e20981299939788a0489d4f9"
server_key_version: "encryptionkey@0"
I20260929 22:49:47.351974 622 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260929 22:49:47.352886 637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:47.353111 622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:47.353247 622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "d4caa199b2cc4d51b50643267084547d"
format_stamp: "Formatted at 2026-09-29 22:49:47 on dist-test-slave-00d6"
server_key: "95b8d807040ccc46ca660bd890c52ce6"
server_key_iv: "bb871243e20981299939788a0489d4f9"
server_key_version: "encryptionkey@0"
I20260929 22:49:47.353327 622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:47.366847 622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:47.369292 622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:47.369446 622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:47.374238 622 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36663
I20260929 22:49:47.374661 622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:47.375272 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 622
I20260929 22:49:47.375381 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:47.375567 12398 external_mini_cluster.cc:1428] Setting key bf92f22d2e26e66ce04c21f2baef06cc
I20260929 22:49:47.381040 689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36663 every 8 connection(s)
I20260929 22:49:47.381664 690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:47.385524 690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d: Bootstrap starting.
I20260929 22:49:47.386266 690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:47.386646 690 log.cc:824] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:47.387300 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:47.381901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41955 (local address 127.0.0.1:36663)
0929 22:49:47.382079 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:47.382089 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:47.382134 (+ 45us) server_negotiation.cc:407] Connection header received
0929 22:49:47.383018 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:47.383027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:47.383091 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:47.383239 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:47.383554 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:47.384543 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:47.385328 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:47.385794 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:47.385912 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:47.386599 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:47.386602 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:47.386603 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:47.386814 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:47.386853 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:47.386864 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:47.386931 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:47.387009 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 22:49:47.387073 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260929 22:49:47.387396 690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d: No bootstrap required, opened a new log
I20260929 22:49:47.388208 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:47.390297 690 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4caa199b2cc4d51b50643267084547d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260929 22:49:47.390482 690 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:47.390519 690 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4caa199b2cc4d51b50643267084547d, State: Initialized, Role: FOLLOWER
I20260929 22:49:47.390647 690 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4caa199b2cc4d51b50643267084547d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260929 22:49:47.390726 690 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:47.390758 690 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:47.390811 690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:47.391582 690 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4caa199b2cc4d51b50643267084547d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260929 22:49:47.391721 690 leader_election.cc:302] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4caa199b2cc4d51b50643267084547d; no voters:
I20260929 22:49:47.391894 690 leader_election.cc:288] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:47.391925 700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:47.392100 700 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [term 1 LEADER]: Becoming Leader. State: Replica: d4caa199b2cc4d51b50643267084547d, State: Running, Role: LEADER
I20260929 22:49:47.392155 690 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:47.392252 700 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4caa199b2cc4d51b50643267084547d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260929 22:49:47.392544 700 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4caa199b2cc4d51b50643267084547d. Latest consensus state: current_term: 1 leader_uuid: "d4caa199b2cc4d51b50643267084547d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4caa199b2cc4d51b50643267084547d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } } }
I20260929 22:49:47.392560 702 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4caa199b2cc4d51b50643267084547d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4caa199b2cc4d51b50643267084547d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } } }
I20260929 22:49:47.392608 700 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:47.392633 702 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:47.392771 704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:47.393253 704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:47.395167 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:47.389472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36201 (local address 127.0.0.1:36663)
0929 22:49:47.389516 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:47.389517 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:47.391823 (+ 2306us) server_negotiation.cc:407] Connection header received
0929 22:49:47.391903 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:47.391904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:47.391915 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:47.391978 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:47.392178 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:47.392851 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:47.393842 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:47.394126 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:47.394172 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:47.394916 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:47.394917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:47.394917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:47.394921 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:47.394934 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:47.394938 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:47.394986 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:47.395043 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 22:49:47.395062 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:49:47.399991 704 catalog_manager.cc:1347] Generated new cluster ID: 5303e531fbc6490899775548f87fe905
I20260929 22:49:47.400040 704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:47.411670 704 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:47.412179 704 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:47.425066 704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4caa199b2cc4d51b50643267084547d: Generated new TSK 0
I20260929 22:49:47.425249 704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:47.428597 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 622
2026-09-29T22:49:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1319 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:47 dist-test-slave-00d6 krb5kdc[721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:47 dist-test-slave-00d6 krb5kdc[721](info): set up 2 sockets
Sep 29 22:49:47 dist-test-slave-00d6 krb5kdc[721](info): commencing operation
krb5kdc: starting...
W20260929 22:49:48.480206 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:48 dist-test-slave-00d6 krb5kdc[721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:48.603034 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38497
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:48.683884 734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:48.684165 734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:48.684208 734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:48.685328 734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:48.685395 734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:48.685420 734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:48.685448 734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:48.685472 734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:48.686909 734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:48.687171 734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:48.687386 734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:48.692047 742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:48.692205 734 server_base.cc:1034] running on GCE node
W20260929 22:49:48.692162 740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:48.692057 739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:48.692555 734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:48.692797 734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:48.693933 734 hybrid_clock.cc:648] HybridClock initialized: now 1790722188693917 us; error 41 us; skew 500 ppm
Sep 29 22:49:48 dist-test-slave-00d6 krb5kdc[721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722188, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:48.702788 734 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:48.703249 734 webserver.cc:460] Webserver started at http://127.0.0.1:46189/ using document root <none> and password file <none>
I20260929 22:49:48.703464 734 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:48.703531 734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:48.703706 734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:48.704779 734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e"
format_stamp: "Formatted at 2026-09-29 22:49:48 on dist-test-slave-00d6"
server_key: "1bf3aa74554e837144f04f77d0313650"
server_key_iv: "3108c012f58771dd828f320b1ed77d7c"
server_key_version: "encryptionkey@0"
I20260929 22:49:48.705163 734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e"
format_stamp: "Formatted at 2026-09-29 22:49:48 on dist-test-slave-00d6"
server_key: "1bf3aa74554e837144f04f77d0313650"
server_key_iv: "3108c012f58771dd828f320b1ed77d7c"
server_key_version: "encryptionkey@0"
I20260929 22:49:48.706521 734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:48.707442 749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:48.707705 734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:48.707813 734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e"
format_stamp: "Formatted at 2026-09-29 22:49:48 on dist-test-slave-00d6"
server_key: "1bf3aa74554e837144f04f77d0313650"
server_key_iv: "3108c012f58771dd828f320b1ed77d7c"
server_key_version: "encryptionkey@0"
I20260929 22:49:48.707895 734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:48.711108 734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:48.713068 734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:48.713219 734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:48.717118 734 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38497
I20260929 22:49:48.717151 801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38497 every 8 connection(s)
I20260929 22:49:48.717486 734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:48.718269 802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:48.720520 802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e: Bootstrap starting.
I20260929 22:49:48.721068 802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:48.721343 802 log.cc:824] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:48.721958 802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e: No bootstrap required, opened a new log
I20260929 22:49:48.723497 802 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38497 } }
I20260929 22:49:48.723680 802 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:48.723742 802 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ce87b337aa4d1bbc1a22f41b37da8e, State: Initialized, Role: FOLLOWER
I20260929 22:49:48.723912 802 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38497 } }
I20260929 22:49:48.724006 802 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:48.724049 802 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:48.724098 802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:48.724597 802 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38497 } }
I20260929 22:49:48.724705 802 leader_election.cc:302] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8ce87b337aa4d1bbc1a22f41b37da8e; no voters:
I20260929 22:49:48.724877 802 leader_election.cc:288] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:48.724922 805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:48.725122 805 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [term 1 LEADER]: Becoming Leader. State: Replica: a8ce87b337aa4d1bbc1a22f41b37da8e, State: Running, Role: LEADER
I20260929 22:49:48.725122 802 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:48.725281 805 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38497 } }
I20260929 22:49:48.725674 807 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8ce87b337aa4d1bbc1a22f41b37da8e. Latest consensus state: current_term: 1 leader_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38497 } } }
I20260929 22:49:48.725684 806 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ce87b337aa4d1bbc1a22f41b37da8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38497 } } }
I20260929 22:49:48.725814 807 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:48.725888 806 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:48.726210 810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:48.726733 810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:48.727500 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 734
I20260929 22:49:48.727609 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:48.727842 12398 external_mini_cluster.cc:1428] Setting key 31d9805e7f64a95b6eda655dfa1b1c7a
I20260929 22:49:48.728404 810 catalog_manager.cc:1347] Generated new cluster ID: 107744f60ffd4b929a7cb70acb55cf14
I20260929 22:49:48.728452 810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:48.730099 825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:48.728331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53073 (local address 127.0.0.1:38497)
0929 22:49:48.728473 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:48.728483 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:48.728672 (+ 189us) server_negotiation.cc:407] Connection header received
0929 22:49:48.728822 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:48.728828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:48.728851 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:48.728980 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:48.729652 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:48.729655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:48.729656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:48.729659 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:48.729699 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:48.729709 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:48.729773 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:48.729851 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 22:49:48.729973 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":71,"threads_started":1}
I20260929 22:49:48.730919 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:48.742712 810 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:48.742890 810 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:48.744431 825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:48.739951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43847 (local address 127.0.0.1:38497)
0929 22:49:48.739990 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:48.739992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:48.742380 (+ 2388us) server_negotiation.cc:407] Connection header received
0929 22:49:48.742452 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:48.742453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:48.742458 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:48.742523 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:48.744196 (+ 1673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:48.744198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:48.744198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:48.744202 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:48.744219 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:48.744223 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:48.744280 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:48.744337 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 22:49:48.744352 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:49:48.745774 810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8ce87b337aa4d1bbc1a22f41b37da8e: Generated new TSK 0
I20260929 22:49:48.745931 810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:48.751878 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 734
2026-09-29T22:49:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:48 dist-test-slave-00d6 krb5kdc[833](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:48 dist-test-slave-00d6 krb5kdc[833](info): set up 2 sockets
Sep 29 22:49:48 dist-test-slave-00d6 krb5kdc[833](info): commencing operation
krb5kdc: starting...
W20260929 22:49:49.792251 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:49 dist-test-slave-00d6 krb5kdc[833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:49.910641 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40447
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:49.996371 846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:49.996593 846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:49.996619 846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:49.997799 846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:49.997846 846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:49.997861 846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:49.997874 846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:49.997886 846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:49.999377 846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:49.999637 846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:49.999925 846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:50.004874 854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:50.004863 852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:50.004863 851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:50.005219 846 server_base.cc:1034] running on GCE node
I20260929 22:49:50.005511 846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:50.005815 846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:50.006995 846 hybrid_clock.cc:648] HybridClock initialized: now 1790722190006982 us; error 48 us; skew 500 ppm
Sep 29 22:49:50 dist-test-slave-00d6 krb5kdc[833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722190, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:50.009724 846 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:50.010263 846 webserver.cc:460] Webserver started at http://127.0.0.1:44579/ using document root <none> and password file <none>
I20260929 22:49:50.010504 846 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:50.010579 846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:50.010733 846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:50.011880 846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "6f6747360cb6419aa3d1ec538045134a"
format_stamp: "Formatted at 2026-09-29 22:49:50 on dist-test-slave-00d6"
server_key: "82d96db0c82946313bcbc260a1232ccc"
server_key_iv: "9c66fa847bd2b0457787923cf8b73590"
server_key_version: "encryptionkey@0"
I20260929 22:49:50.012281 846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "6f6747360cb6419aa3d1ec538045134a"
format_stamp: "Formatted at 2026-09-29 22:49:50 on dist-test-slave-00d6"
server_key: "82d96db0c82946313bcbc260a1232ccc"
server_key_iv: "9c66fa847bd2b0457787923cf8b73590"
server_key_version: "encryptionkey@0"
I20260929 22:49:50.013581 846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:50.014336 861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:50.014536 846 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:49:50.014655 846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "6f6747360cb6419aa3d1ec538045134a"
format_stamp: "Formatted at 2026-09-29 22:49:50 on dist-test-slave-00d6"
server_key: "82d96db0c82946313bcbc260a1232ccc"
server_key_iv: "9c66fa847bd2b0457787923cf8b73590"
server_key_version: "encryptionkey@0"
I20260929 22:49:50.014732 846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:50.027617 846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:50.029599 846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:50.029771 846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:50.033732 846 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40447
I20260929 22:49:50.033768 914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40447 every 8 connection(s)
I20260929 22:49:50.034137 846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:50.034981 915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:50.035323 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 846
I20260929 22:49:50.035439 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:50.035668 12398 external_mini_cluster.cc:1428] Setting key a8f3479ae2036c1b11e1e84a8b0906e6
I20260929 22:49:50.037923 915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a: Bootstrap starting.
I20260929 22:49:50.038516 915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:50.038863 915 log.cc:824] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:50.039544 915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a: No bootstrap required, opened a new log
I20260929 22:49:50.041903 915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f6747360cb6419aa3d1ec538045134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260929 22:49:50.042079 915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:50.042117 915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6747360cb6419aa3d1ec538045134a, State: Initialized, Role: FOLLOWER
I20260929 22:49:50.042243 915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f6747360cb6419aa3d1ec538045134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
Sep 29 22:49:50 dist-test-slave-00d6 krb5kdc[833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:49:50.042321 915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:50.042357 915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:50.042410 915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:50.043107 915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f6747360cb6419aa3d1ec538045134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260929 22:49:50.043218 915 leader_election.cc:302] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f6747360cb6419aa3d1ec538045134a; no voters:
I20260929 22:49:50.043390 915 leader_election.cc:288] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:50.043443 920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:50.043648 920 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [term 1 LEADER]: Becoming Leader. State: Replica: 6f6747360cb6419aa3d1ec538045134a, State: Running, Role: LEADER
I20260929 22:49:50.043725 915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:50.043836 920 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f6747360cb6419aa3d1ec538045134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260929 22:49:50.044348 922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f6747360cb6419aa3d1ec538045134a. Latest consensus state: current_term: 1 leader_uuid: "6f6747360cb6419aa3d1ec538045134a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f6747360cb6419aa3d1ec538045134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } } }
I20260929 22:49:50.044524 922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:50.044764 929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:50.045315 929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:50.045897 921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f6747360cb6419aa3d1ec538045134a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f6747360cb6419aa3d1ec538045134a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } } }
I20260929 22:49:50.046010 921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:50.046633 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:50.036188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:47655 (local address 127.0.0.1:40447)
0929 22:49:50.036361 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:50.036368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:50.036393 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:49:50.036793 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:50.036799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:50.036845 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:50.036959 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:50.037726 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:50.038595 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:50.039604 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:50.040229 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:50.040348 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:50.042848 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:50.042851 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:50.042851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:50.042861 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:50.044891 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:50.045374 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:50.045377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:50.045377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:50.045474 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:50.045711 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:50.045712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:50.045712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:50.045938 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:50.046123 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:50.046338 (+ 215us) server_negotiation.cc:299] Negotiation successful
0929 22:49:50.046443 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260929 22:49:50.047176 929 catalog_manager.cc:1347] Generated new cluster ID: d8f4c4ee90d84c8285e5ec57d7dc80ef
I20260929 22:49:50.047231 929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:50.047586 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:50.058185 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:50.052017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:35713 (local address 127.0.0.1:40447)
0929 22:49:50.052060 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:50.052063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:50.052199 (+ 136us) server_negotiation.cc:407] Connection header received
0929 22:49:50.052263 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:50.052264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:50.052275 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:50.052329 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:50.052844 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:50.053319 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:50.054037 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:50.054260 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:50.054332 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:50.055530 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:50.055532 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:50.055532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:50.055538 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:50.057006 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:50.057371 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:50.057372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:50.057373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:50.057429 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:50.057660 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:50.057661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:50.057662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:50.057770 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:50.057891 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:50.058009 (+ 118us) server_negotiation.cc:299] Negotiation successful
0929 22:49:50.058071 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 22:49:50.062017 929 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:50.062702 929 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:50.072497 929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f6747360cb6419aa3d1ec538045134a: Generated new TSK 0
I20260929 22:49:50.072703 929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:50.074659 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 846
W20260929 22:49:50.078933 831 connection.cc:535] client connection to 127.0.0.1:40447 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40447): Connection reset by peer (error 104)
2026-09-29T22:49:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:50 dist-test-slave-00d6 krb5kdc[946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:50 dist-test-slave-00d6 krb5kdc[946](info): set up 2 sockets
Sep 29 22:49:50 dist-test-slave-00d6 krb5kdc[946](info): commencing operation
krb5kdc: starting...
W20260929 22:49:51.108175 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:51 dist-test-slave-00d6 krb5kdc[946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:51.224304 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46107
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:51.305004 959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:51.305218 959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:51.305243 959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:51.306452 959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:51.306500 959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:51.306515 959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:51.306528 959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:51.306540 959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:51.308077 959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:51.308339 959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:51.308585 959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:51.313548 967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:51.313573 965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:51.313576 964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:51.313628 959 server_base.cc:1034] running on GCE node
I20260929 22:49:51.314013 959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:51.314314 959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:51.315480 959 hybrid_clock.cc:648] HybridClock initialized: now 1790722191315475 us; error 38 us; skew 500 ppm
Sep 29 22:49:51 dist-test-slave-00d6 krb5kdc[946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:51.317919 959 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:51.318387 959 webserver.cc:460] Webserver started at http://127.0.0.1:33805/ using document root <none> and password file <none>
I20260929 22:49:51.318581 959 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:51.318627 959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:51.318718 959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:51.319808 959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "817eb7d2d0d042bebe8738415483ef3e"
format_stamp: "Formatted at 2026-09-29 22:49:51 on dist-test-slave-00d6"
server_key: "0e38a9e96a65a480e7b6a5a3e006ad3d"
server_key_iv: "8bd281f9955127e1b26807bfa4babccb"
server_key_version: "encryptionkey@0"
I20260929 22:49:51.320147 959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "817eb7d2d0d042bebe8738415483ef3e"
format_stamp: "Formatted at 2026-09-29 22:49:51 on dist-test-slave-00d6"
server_key: "0e38a9e96a65a480e7b6a5a3e006ad3d"
server_key_iv: "8bd281f9955127e1b26807bfa4babccb"
server_key_version: "encryptionkey@0"
I20260929 22:49:51.321383 959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:51.322050 974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:51.322257 959 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:49:51.322345 959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "817eb7d2d0d042bebe8738415483ef3e"
format_stamp: "Formatted at 2026-09-29 22:49:51 on dist-test-slave-00d6"
server_key: "0e38a9e96a65a480e7b6a5a3e006ad3d"
server_key_iv: "8bd281f9955127e1b26807bfa4babccb"
server_key_version: "encryptionkey@0"
I20260929 22:49:51.322397 959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:51.334790 959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:51.337146 959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:51.337258 959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:51.341063 959 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46107
I20260929 22:49:51.341117 1026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46107 every 8 connection(s)
I20260929 22:49:51.341470 959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:51.342373 1027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:51.344691 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e: Bootstrap starting.
I20260929 22:49:51.345284 1027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:51.345584 1027 log.cc:824] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:51.346288 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e: No bootstrap required, opened a new log
I20260929 22:49:51.348013 1027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817eb7d2d0d042bebe8738415483ef3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260929 22:49:51.348177 1027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:51.348253 1027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817eb7d2d0d042bebe8738415483ef3e, State: Initialized, Role: FOLLOWER
I20260929 22:49:51.348450 1027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817eb7d2d0d042bebe8738415483ef3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260929 22:49:51.348559 1027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:51.348604 1027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:51.348658 1027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:51.349004 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 959
I20260929 22:49:51.349094 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:51.349258 1027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817eb7d2d0d042bebe8738415483ef3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260929 22:49:51.349310 12398 external_mini_cluster.cc:1428] Setting key 241283c3404f8eaacd9c8f89ca2c8717
I20260929 22:49:51.349373 1027 leader_election.cc:302] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 817eb7d2d0d042bebe8738415483ef3e; no voters:
I20260929 22:49:51.349558 1027 leader_election.cc:288] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:51.349604 1030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:51.349808 1027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:51.349829 1030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [term 1 LEADER]: Becoming Leader. State: Replica: 817eb7d2d0d042bebe8738415483ef3e, State: Running, Role: LEADER
I20260929 22:49:51.350037 1030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817eb7d2d0d042bebe8738415483ef3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } }
I20260929 22:49:51.350435 1031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 817eb7d2d0d042bebe8738415483ef3e. Latest consensus state: current_term: 1 leader_uuid: "817eb7d2d0d042bebe8738415483ef3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817eb7d2d0d042bebe8738415483ef3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } } }
I20260929 22:49:51.350569 1033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "817eb7d2d0d042bebe8738415483ef3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817eb7d2d0d042bebe8738415483ef3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46107 } } }
I20260929 22:49:51.350574 1031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:51.350670 1033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e [sys.catalog]: This master's current role is: LEADER
W20260929 22:49:51.351851 1047 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:49:51.351915 1047 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:49:51.352013 1041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:51.352183 1041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:51.353772 1041 catalog_manager.cc:1347] Generated new cluster ID: 29718ef8b6ce41b1874d22c913961623
I20260929 22:49:51.353821 1041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:51.355803 1034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:51.349788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:53305 (local address 127.0.0.1:46107)
0929 22:49:51.350005 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:51.350015 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:51.350188 (+ 173us) server_negotiation.cc:407] Connection header received
0929 22:49:51.350317 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:51.350326 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:51.350396 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:51.350563 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:51.351017 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:51.352529 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:51.353589 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:51.354200 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:51.354300 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:51.355083 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:51.355087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:51.355088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:51.355291 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:51.355328 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:51.355341 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:51.355421 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:51.355543 (+ 122us) server_negotiation.cc:299] Negotiation successful
0929 22:49:51.355567 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":69,"threads_started":1}
I20260929 22:49:51.356792 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:51.361769 1041 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:51.362156 1034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:51.358287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:37105 (local address 127.0.0.1:46107)
0929 22:49:51.358319 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:51.358321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:51.358329 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:49:51.358375 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:51.358376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:51.358385 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:51.358450 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:51.358581 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:51.359694 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:51.360672 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:51.361016 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:51.361092 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:51.361875 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:51.361876 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:51.361876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:51.361880 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:51.361893 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:51.361897 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:51.361977 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:51.362042 (+ 65us) server_negotiation.cc:299] Negotiation successful
0929 22:49:51.362051 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":16}
I20260929 22:49:51.362488 1041 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:51.367234 1041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 817eb7d2d0d042bebe8738415483ef3e: Generated new TSK 0
I20260929 22:49:51.367403 1041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:51.369961 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 959
W20260929 22:49:51.373720 944 connection.cc:535] client connection to 127.0.0.1:46107 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46107): Connection reset by peer (error 104)
2026-09-29T22:49:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:51 dist-test-slave-00d6 krb5kdc[1058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:51 dist-test-slave-00d6 krb5kdc[1058](info): set up 2 sockets
Sep 29 22:49:51 dist-test-slave-00d6 krb5kdc[1058](info): commencing operation
krb5kdc: starting...
W20260929 22:49:52.400228 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:52 dist-test-slave-00d6 krb5kdc[1058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:52.517963 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40257
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:52.612049 1071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:52.612382 1071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:52.612437 1071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:52.613816 1071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:52.613864 1071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:52.613885 1071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:52.613903 1071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:52.613920 1071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:52.616461 1071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:52.616729 1071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:52.616972 1071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:52.622591 1076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:52.622599 1079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:52.622599 1077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:52.623117 1071 server_base.cc:1034] running on GCE node
I20260929 22:49:52.623387 1071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:52.623711 1071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:52.624882 1071 hybrid_clock.cc:648] HybridClock initialized: now 1790722192624870 us; error 31 us; skew 500 ppm
Sep 29 22:49:52 dist-test-slave-00d6 krb5kdc[1058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722192, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:52.627372 1071 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:52.627897 1071 webserver.cc:460] Webserver started at http://127.0.0.1:36739/ using document root <none> and password file <none>
I20260929 22:49:52.628134 1071 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:52.628204 1071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:52.628340 1071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:52.629405 1071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "0be73cfd814b437c9f99a91d3be3cb33"
format_stamp: "Formatted at 2026-09-29 22:49:52 on dist-test-slave-00d6"
server_key: "7e112a324ca28b6014d1d0c6ecbe4ca4"
server_key_iv: "b9efbb4af59f32da674632023d15fbc0"
server_key_version: "encryptionkey@0"
I20260929 22:49:52.629773 1071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "0be73cfd814b437c9f99a91d3be3cb33"
format_stamp: "Formatted at 2026-09-29 22:49:52 on dist-test-slave-00d6"
server_key: "7e112a324ca28b6014d1d0c6ecbe4ca4"
server_key_iv: "b9efbb4af59f32da674632023d15fbc0"
server_key_version: "encryptionkey@0"
I20260929 22:49:52.631278 1071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:49:52.632148 1086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:52.632359 1071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:49:52.632450 1071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "0be73cfd814b437c9f99a91d3be3cb33"
format_stamp: "Formatted at 2026-09-29 22:49:52 on dist-test-slave-00d6"
server_key: "7e112a324ca28b6014d1d0c6ecbe4ca4"
server_key_iv: "b9efbb4af59f32da674632023d15fbc0"
server_key_version: "encryptionkey@0"
I20260929 22:49:52.632522 1071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:52.635869 1071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:52.637742 1071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:52.637892 1071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:52.641681 1071 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40257
I20260929 22:49:52.641713 1138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40257 every 8 connection(s)
I20260929 22:49:52.642030 1071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:52.642284 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1071
I20260929 22:49:52.642401 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:52.642578 12398 external_mini_cluster.cc:1428] Setting key 543b00186688a14a3efbfaecc694668e
I20260929 22:49:52.642944 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:52.645262 1142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:52.643082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:48251 (local address 127.0.0.1:40257)
0929 22:49:52.643285 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:52.643324 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:52.643357 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:49:52.644023 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:52.644030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:52.644056 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:52.644199 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:52.644860 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:52.644864 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:52.644864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:52.644869 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:52.644907 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:52.644917 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:52.644991 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:52.645059 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 22:49:52.645102 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
I20260929 22:49:52.646214 1139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33: Bootstrap starting.
I20260929 22:49:52.646281 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:52.646786 1139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:52.647076 1139 log.cc:824] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:52.647881 1139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33: No bootstrap required, opened a new log
I20260929 22:49:52.648744 1142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:52.647729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:37087 (local address 127.0.0.1:40257)
0929 22:49:52.647763 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:52.647765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:52.647884 (+ 119us) server_negotiation.cc:407] Connection header received
0929 22:49:52.647958 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:52.647959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:52.647964 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:52.648018 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:52.648531 (+ 513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:52.648532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:52.648532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:52.648536 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:52.648549 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:52.648552 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:52.648607 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:52.648664 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 22:49:52.648678 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:49:52.650038 1139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be73cfd814b437c9f99a91d3be3cb33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40257 } }
I20260929 22:49:52.650177 1139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:52.650202 1139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be73cfd814b437c9f99a91d3be3cb33, State: Initialized, Role: FOLLOWER
I20260929 22:49:52.650318 1139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be73cfd814b437c9f99a91d3be3cb33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40257 } }
I20260929 22:49:52.650441 1139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:52.650481 1139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:52.650533 1139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:52.651156 1139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be73cfd814b437c9f99a91d3be3cb33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40257 } }
I20260929 22:49:52.651250 1139 leader_election.cc:302] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0be73cfd814b437c9f99a91d3be3cb33; no voters:
I20260929 22:49:52.651365 1139 leader_election.cc:288] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:52.651436 1149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:52.651582 1149 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [term 1 LEADER]: Becoming Leader. State: Replica: 0be73cfd814b437c9f99a91d3be3cb33, State: Running, Role: LEADER
I20260929 22:49:52.651608 1139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:52.651693 1149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be73cfd814b437c9f99a91d3be3cb33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40257 } }
I20260929 22:49:52.652047 1151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0be73cfd814b437c9f99a91d3be3cb33. Latest consensus state: current_term: 1 leader_uuid: "0be73cfd814b437c9f99a91d3be3cb33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be73cfd814b437c9f99a91d3be3cb33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40257 } } }
I20260929 22:49:52.652168 1151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:52.652047 1150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0be73cfd814b437c9f99a91d3be3cb33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0be73cfd814b437c9f99a91d3be3cb33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40257 } } }
I20260929 22:49:52.652369 1150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:52.652475 1157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:52.652937 1157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:52.654386 1157 catalog_manager.cc:1347] Generated new cluster ID: f551524426244a49ab78e126056a2c8c
I20260929 22:49:52.654439 1157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:52.707795 1157 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:52.708004 1157 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:52.716585 1157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0be73cfd814b437c9f99a91d3be3cb33: Generated new TSK 0
I20260929 22:49:52.716784 1157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:52.719769 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1071
2026-09-29T22:49:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:52 dist-test-slave-00d6 krb5kdc[1170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:52 dist-test-slave-00d6 krb5kdc[1170](info): set up 2 sockets
Sep 29 22:49:52 dist-test-slave-00d6 krb5kdc[1170](info): commencing operation
krb5kdc: starting...
W20260929 22:49:53.756999 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.001s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:53 dist-test-slave-00d6 krb5kdc[1170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:53.874943 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:53.955394 1183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:53.955662 1183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:53.955716 1183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:53.956878 1183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:53.956951 1183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:53.956977 1183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:53.957005 1183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:53.957033 1183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:53.958515 1183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:53.958798 1183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:53.959038 1183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:53.963862 1189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:53.963871 1188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:53.963970 1183 server_base.cc:1034] running on GCE node
W20260929 22:49:53.963881 1191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:53.964289 1183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:53.964576 1183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:53.965741 1183 hybrid_clock.cc:648] HybridClock initialized: now 1790722193965727 us; error 45 us; skew 500 ppm
Sep 29 22:49:53 dist-test-slave-00d6 krb5kdc[1170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722193, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:53.971481 1183 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:53.972040 1183 webserver.cc:460] Webserver started at http://127.0.0.1:37469/ using document root <none> and password file <none>
I20260929 22:49:53.972267 1183 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:53.972332 1183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:53.972486 1183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:53.973577 1183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "1f3de8d63bb8418f9e6e066a64a7931b"
format_stamp: "Formatted at 2026-09-29 22:49:53 on dist-test-slave-00d6"
server_key: "18705b4f60a5efb8e82ab4f44579af6e"
server_key_iv: "b8e08e068c79e5a7f976310536035ac2"
server_key_version: "encryptionkey@0"
I20260929 22:49:53.973965 1183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "1f3de8d63bb8418f9e6e066a64a7931b"
format_stamp: "Formatted at 2026-09-29 22:49:53 on dist-test-slave-00d6"
server_key: "18705b4f60a5efb8e82ab4f44579af6e"
server_key_iv: "b8e08e068c79e5a7f976310536035ac2"
server_key_version: "encryptionkey@0"
I20260929 22:49:53.975301 1183 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:49:53.976150 1198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:53.976330 1183 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:49:53.976429 1183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1f3de8d63bb8418f9e6e066a64a7931b"
format_stamp: "Formatted at 2026-09-29 22:49:53 on dist-test-slave-00d6"
server_key: "18705b4f60a5efb8e82ab4f44579af6e"
server_key_iv: "b8e08e068c79e5a7f976310536035ac2"
server_key_version: "encryptionkey@0"
I20260929 22:49:53.976511 1183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:53.991379 1183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:53.993314 1183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:53.993477 1183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:53.997467 1183 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36061
I20260929 22:49:53.997498 1250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36061 every 8 connection(s)
I20260929 22:49:53.997921 1183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:53.998819 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:53.999583 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1183
I20260929 22:49:53.999714 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:53.999938 12398 external_mini_cluster.cc:1428] Setting key 325a71654a8fc592c2009ede6f538544
I20260929 22:49:54.002167 1251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b: Bootstrap starting.
I20260929 22:49:54.002779 1251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:54.003072 1251 log.cc:824] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:54.003808 1251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b: No bootstrap required, opened a new log
I20260929 22:49:54.005576 1251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36061 } }
I20260929 22:49:54.005714 1251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:54.005738 1251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f3de8d63bb8418f9e6e066a64a7931b, State: Initialized, Role: FOLLOWER
I20260929 22:49:54.005869 1251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36061 } }
I20260929 22:49:54.005959 1251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:54.005993 1251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:54.006042 1251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 0 FOLLOWER]: Advancing to term 1
Sep 29 22:49:54 dist-test-slave-00d6 krb5kdc[1170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 22:49:54.006623 1251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36061 } }
I20260929 22:49:54.006733 1251 leader_election.cc:302] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f3de8d63bb8418f9e6e066a64a7931b; no voters:
I20260929 22:49:54.006912 1251 leader_election.cc:288] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:54.006953 1256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:54.007073 1256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [term 1 LEADER]: Becoming Leader. State: Replica: 1f3de8d63bb8418f9e6e066a64a7931b, State: Running, Role: LEADER
I20260929 22:49:54.007176 1251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:54.007159 1256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36061 } }
I20260929 22:49:54.007488 1256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f3de8d63bb8418f9e6e066a64a7931b. Latest consensus state: current_term: 1 leader_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36061 } } }
I20260929 22:49:54.007579 1256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:54.007807 1258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de8d63bb8418f9e6e066a64a7931b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36061 } } }
I20260929 22:49:54.007866 1262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:54.007946 1258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:54.008435 1262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:54.010465 1262 catalog_manager.cc:1347] Generated new cluster ID: 166efcc4306f4867a398a8c544de2482
I20260929 22:49:54.010510 1262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:54.010891 1254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:54.000553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:48613 (local address 127.0.0.1:36061)
0929 22:49:54.000746 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:54.000754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:54.000779 (+ 25us) server_negotiation.cc:407] Connection header received
0929 22:49:54.001181 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:54.001188 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:54.001236 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:54.001346 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:54.002138 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:54.003111 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:54.003966 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:54.004386 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:54.004503 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:54.007082 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:54.007087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:54.007087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:54.007102 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:54.009166 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:54.009657 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:54.009660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:54.009661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:54.009755 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:54.009984 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:54.009985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:54.009985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:54.010257 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:54.010435 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:54.010562 (+ 127us) server_negotiation.cc:299] Negotiation successful
0929 22:49:54.010663 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260929 22:49:54.011881 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:54.022004 1254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:54.015885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:54731 (local address 127.0.0.1:36061)
0929 22:49:54.015919 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:54.015921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:54.016090 (+ 169us) server_negotiation.cc:407] Connection header received
0929 22:49:54.016148 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:54.016149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:54.016159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:54.016220 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:54.016743 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:54.017234 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:54.017944 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:54.018175 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:54.018258 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:54.019454 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:54.019456 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:54.019456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:54.019463 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:54.020850 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:54.021220 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:54.021221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:54.021221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:54.021280 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:54.021499 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:54.021500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:54.021500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:54.021611 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:54.021716 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:54.021848 (+ 132us) server_negotiation.cc:299] Negotiation successful
0929 22:49:54.021909 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:49:54.026525 1262 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:54.027200 1262 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:54.030392 1262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f3de8d63bb8418f9e6e066a64a7931b: Generated new TSK 0
I20260929 22:49:54.030553 1262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:54.035046 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1183
W20260929 22:49:54.039384 1168 connection.cc:535] client connection to 127.0.0.1:36061 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36061): Connection reset by peer (error 104)
2026-09-29T22:49:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1314 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:54 dist-test-slave-00d6 krb5kdc[1282](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:54 dist-test-slave-00d6 krb5kdc[1282](info): set up 2 sockets
Sep 29 22:49:54 dist-test-slave-00d6 krb5kdc[1282](info): commencing operation
krb5kdc: starting...
W20260929 22:49:55.072256 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:55 dist-test-slave-00d6 krb5kdc[1282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:55.190222 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34611
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:55.268851 1295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:55.269089 1295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:55.269125 1295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:55.270265 1295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:55.270340 1295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:55.270364 1295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:55.270386 1295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:55.270412 1295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:55.271871 1295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34611
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:55.272166 1295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:55.272394 1295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:55.277325 1300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:55.277352 1301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:55.277326 1303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:55.277346 1295 server_base.cc:1034] running on GCE node
I20260929 22:49:55.277824 1295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:55.278121 1295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:55.279266 1295 hybrid_clock.cc:648] HybridClock initialized: now 1790722195279240 us; error 48 us; skew 500 ppm
Sep 29 22:49:55 dist-test-slave-00d6 krb5kdc[1282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:55.281848 1295 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:55.282246 1295 webserver.cc:460] Webserver started at http://127.0.0.1:45483/ using document root <none> and password file <none>
I20260929 22:49:55.282447 1295 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:55.282491 1295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:55.282639 1295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:55.283747 1295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "76397039a5a74f2b96a535e711d2d132"
format_stamp: "Formatted at 2026-09-29 22:49:55 on dist-test-slave-00d6"
server_key: "174f84bf27713916eca683ab826a0f9f"
server_key_iv: "1ed8b4d64c9fcb6115b61f46f7462fde"
server_key_version: "encryptionkey@0"
I20260929 22:49:55.284169 1295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "76397039a5a74f2b96a535e711d2d132"
format_stamp: "Formatted at 2026-09-29 22:49:55 on dist-test-slave-00d6"
server_key: "174f84bf27713916eca683ab826a0f9f"
server_key_iv: "1ed8b4d64c9fcb6115b61f46f7462fde"
server_key_version: "encryptionkey@0"
I20260929 22:49:55.285403 1295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 22:49:55.286087 1310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:55.286275 1295 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 22:49:55.286356 1295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "76397039a5a74f2b96a535e711d2d132"
format_stamp: "Formatted at 2026-09-29 22:49:55 on dist-test-slave-00d6"
server_key: "174f84bf27713916eca683ab826a0f9f"
server_key_iv: "1ed8b4d64c9fcb6115b61f46f7462fde"
server_key_version: "encryptionkey@0"
I20260929 22:49:55.286407 1295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:55.302304 1295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:55.304147 1295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:55.304286 1295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:55.308097 1295 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34611
I20260929 22:49:55.308175 1362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34611 every 8 connection(s)
I20260929 22:49:55.308508 1295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:55.309370 1363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:55.311576 1363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132: Bootstrap starting.
I20260929 22:49:55.312173 1363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:55.312469 1363 log.cc:824] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:55.313127 1363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132: No bootstrap required, opened a new log
I20260929 22:49:55.314536 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1295
I20260929 22:49:55.314663 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:55.314896 12398 external_mini_cluster.cc:1428] Setting key 3d65ae950d5b133cc68ca981a84025b5
I20260929 22:49:55.315006 1363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76397039a5a74f2b96a535e711d2d132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34611 } }
I20260929 22:49:55.315168 1363 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:55.315222 1363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76397039a5a74f2b96a535e711d2d132, State: Initialized, Role: FOLLOWER
I20260929 22:49:55.315618 1363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76397039a5a74f2b96a535e711d2d132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34611 } }
I20260929 22:49:55.315737 1363 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:55.315770 1363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:55.315817 1363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:55.316923 1363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76397039a5a74f2b96a535e711d2d132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34611 } }
I20260929 22:49:55.317029 1363 leader_election.cc:302] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76397039a5a74f2b96a535e711d2d132; no voters:
I20260929 22:49:55.317175 1363 leader_election.cc:288] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:55.317229 1368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:55.317394 1368 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [term 1 LEADER]: Becoming Leader. State: Replica: 76397039a5a74f2b96a535e711d2d132, State: Running, Role: LEADER
I20260929 22:49:55.317400 1363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:55.318130 1368 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76397039a5a74f2b96a535e711d2d132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34611 } }
I20260929 22:49:55.319052 1369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76397039a5a74f2b96a535e711d2d132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76397039a5a74f2b96a535e711d2d132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34611 } } }
I20260929 22:49:55.319238 1370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76397039a5a74f2b96a535e711d2d132. Latest consensus state: current_term: 1 leader_uuid: "76397039a5a74f2b96a535e711d2d132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76397039a5a74f2b96a535e711d2d132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34611 } } }
I20260929 22:49:55.319340 1370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:55.319566 1369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132 [sys.catalog]: This master's current role is: LEADER
W20260929 22:49:55.319615 1382 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:49:55.319726 1382 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:49:55.320098 1385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:55.320286 1385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:55.321005 1367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:55.315396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:37199 (local address 127.0.0.1:34611)
0929 22:49:55.315568 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:55.315578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:55.315610 (+ 32us) server_negotiation.cc:407] Connection header received
0929 22:49:55.315749 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:55.315757 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:55.315817 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:55.315972 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:55.316163 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:55.317561 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:55.318813 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:55.319406 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:55.319528 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:55.320317 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:55.320336 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:55.320336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:55.320532 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:55.320563 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:55.320574 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:55.320669 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:55.320759 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 22:49:55.320789 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260929 22:49:55.322012 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:55.322185 1385 catalog_manager.cc:1347] Generated new cluster ID: 16677e3e7a724c6db98da6acaf7601e3
I20260929 22:49:55.322232 1385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:55.326973 1367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:55.323424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:47433 (local address 127.0.0.1:34611)
0929 22:49:55.323458 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:55.323460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:55.323655 (+ 195us) server_negotiation.cc:407] Connection header received
0929 22:49:55.323680 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:55.323681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:55.323704 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:55.323765 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:55.323910 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:55.324630 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:55.325637 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:55.325977 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:55.326048 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:55.326731 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:55.326732 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:55.326732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:55.326737 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:55.326752 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:55.326756 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:55.326815 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:55.326893 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 22:49:55.326905 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:49:55.338392 1385 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:55.338902 1385 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:55.342805 1385 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76397039a5a74f2b96a535e711d2d132: Generated new TSK 0
I20260929 22:49:55.342979 1385 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:55.346969 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1295
W20260929 22:49:55.350855 1280 connection.cc:535] client connection to 127.0.0.1:34611 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34611): Connection reset by peer (error 104)
2026-09-29T22:49:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1311 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:55 dist-test-slave-00d6 krb5kdc[1394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:55 dist-test-slave-00d6 krb5kdc[1394](info): set up 2 sockets
Sep 29 22:49:55 dist-test-slave-00d6 krb5kdc[1394](info): commencing operation
krb5kdc: starting...
W20260929 22:49:56.376209 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:56 dist-test-slave-00d6 krb5kdc[1394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 22:49:56.492559 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:56.572209 1407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:56.572429 1407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:56.572453 1407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:56.573635 1407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:56.573679 1407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:56.573693 1407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:56.573706 1407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:56.573750 1407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:56.575237 1407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44731
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:56.575496 1407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:56.575758 1407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:56.582044 1415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:56.582120 1413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:56.582383 1407 server_base.cc:1034] running on GCE node
W20260929 22:49:56.582054 1412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:56.582719 1407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:56.583055 1407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:56.584204 1407 hybrid_clock.cc:648] HybridClock initialized: now 1790722196584174 us; error 39 us; skew 500 ppm
Sep 29 22:49:56 dist-test-slave-00d6 krb5kdc[1394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722196, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:56.586745 1407 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 22:49:56.587231 1407 webserver.cc:460] Webserver started at http://127.0.0.1:39673/ using document root <none> and password file <none>
I20260929 22:49:56.587473 1407 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:56.587549 1407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:56.587723 1407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:56.588814 1407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "c5355a76fae740f3a1714f75f3352aab"
format_stamp: "Formatted at 2026-09-29 22:49:56 on dist-test-slave-00d6"
server_key: "652510250419511b04c91eb75ed8d735"
server_key_iv: "2dbeb50e61c22c55e3b5a4a4ffbaf558"
server_key_version: "encryptionkey@0"
I20260929 22:49:56.589185 1407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "c5355a76fae740f3a1714f75f3352aab"
format_stamp: "Formatted at 2026-09-29 22:49:56 on dist-test-slave-00d6"
server_key: "652510250419511b04c91eb75ed8d735"
server_key_iv: "2dbeb50e61c22c55e3b5a4a4ffbaf558"
server_key_version: "encryptionkey@0"
I20260929 22:49:56.590512 1407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:49:56.591259 1422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:56.591442 1407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:56.591540 1407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "c5355a76fae740f3a1714f75f3352aab"
format_stamp: "Formatted at 2026-09-29 22:49:56 on dist-test-slave-00d6"
server_key: "652510250419511b04c91eb75ed8d735"
server_key_iv: "2dbeb50e61c22c55e3b5a4a4ffbaf558"
server_key_version: "encryptionkey@0"
I20260929 22:49:56.591674 1407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:56.595005 1407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:56.597229 1407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:56.597399 1407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:56.601686 1407 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44731
I20260929 22:49:56.601730 1474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44731 every 8 connection(s)
I20260929 22:49:56.602085 1407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:56.603010 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:56.605335 1475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab: Bootstrap starting.
I20260929 22:49:56.605863 1475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:56.606096 1475 log.cc:824] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:56.606715 1475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab: No bootstrap required, opened a new log
I20260929 22:49:56.607017 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1407
I20260929 22:49:56.607128 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:56.607331 12398 external_mini_cluster.cc:1428] Setting key 4f0f3a0f2e337b312ee3349d74f2fd1f
I20260929 22:49:56.608896 1475 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5355a76fae740f3a1714f75f3352aab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44731 } }
I20260929 22:49:56.609081 1475 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:56.609124 1475 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5355a76fae740f3a1714f75f3352aab, State: Initialized, Role: FOLLOWER
I20260929 22:49:56.609280 1475 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5355a76fae740f3a1714f75f3352aab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44731 } }
I20260929 22:49:56.609395 1475 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:56.609427 1475 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:56.609475 1475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:56.610216 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:56.607880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:36145 (local address 127.0.0.1:44731)
0929 22:49:56.608049 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:56.608062 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:56.608117 (+ 55us) server_negotiation.cc:407] Connection header received
0929 22:49:56.608876 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:56.608882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:56.608907 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:56.609018 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:56.609757 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:56.609760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:56.609761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:56.609765 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:56.609814 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:56.609825 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:56.609901 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:56.609970 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 22:49:56.610014 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260929 22:49:56.610404 1475 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5355a76fae740f3a1714f75f3352aab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44731 } }
I20260929 22:49:56.610508 1475 leader_election.cc:302] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5355a76fae740f3a1714f75f3352aab; no voters:
I20260929 22:49:56.610699 1475 leader_election.cc:288] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:56.610780 1480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:56.610913 1480 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [term 1 LEADER]: Becoming Leader. State: Replica: c5355a76fae740f3a1714f75f3352aab, State: Running, Role: LEADER
I20260929 22:49:56.610954 1475 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:56.611070 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:56.611090 1480 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5355a76fae740f3a1714f75f3352aab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44731 } }
I20260929 22:49:56.612284 1482 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5355a76fae740f3a1714f75f3352aab. Latest consensus state: current_term: 1 leader_uuid: "c5355a76fae740f3a1714f75f3352aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5355a76fae740f3a1714f75f3352aab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44731 } } }
I20260929 22:49:56.612493 1482 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:56.612663 1481 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5355a76fae740f3a1714f75f3352aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5355a76fae740f3a1714f75f3352aab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44731 } } }
I20260929 22:49:56.612746 1481 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab [sys.catalog]: This master's current role is: LEADER
W20260929 22:49:56.612834 1498 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:49:56.612914 1498 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:49:56.613093 1501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:56.613302 1501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:56.614156 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:56.612809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.195:52969 (local address 127.0.0.1:44731)
0929 22:49:56.612840 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:56.612842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:56.613074 (+ 232us) server_negotiation.cc:407] Connection header received
0929 22:49:56.613207 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:56.613208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:56.613214 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:56.613245 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:56.613932 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:56.613934 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:56.613934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:56.613938 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:56.613951 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:56.613955 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:56.614003 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:56.614057 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 22:49:56.614078 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 22:49:56.614895 1501 catalog_manager.cc:1347] Generated new cluster ID: b5bcce7a19494a729ec80bf96771bab8
I20260929 22:49:56.614944 1501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:56.626962 1501 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:56.627133 1501 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:56.634588 1501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5355a76fae740f3a1714f75f3352aab: Generated new TSK 0
I20260929 22:49:56.634778 1501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:56.642419 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1407
2026-09-29T22:49:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:56 dist-test-slave-00d6 krb5kdc[1506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:56 dist-test-slave-00d6 krb5kdc[1506](info): set up 2 sockets
Sep 29 22:49:56 dist-test-slave-00d6 krb5kdc[1506](info): commencing operation
krb5kdc: starting...
W20260929 22:49:57.672644 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:57 dist-test-slave-00d6 krb5kdc[1506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:49:57.791298 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46393
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:46393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:57.871393 1519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:57.871596 1519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:57.871619 1519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:57.872824 1519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:57.872867 1519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:57.872882 1519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:57.872895 1519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:57.872934 1519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:57.874397 1519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:46393
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:57.874634 1519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:57.874858 1519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:57.879616 1524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:57.879652 1525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:57.879734 1519 server_base.cc:1034] running on GCE node
W20260929 22:49:57.879648 1527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:57.880147 1519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:57.880385 1519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:57.881525 1519 hybrid_clock.cc:648] HybridClock initialized: now 1790722197881514 us; error 28 us; skew 500 ppm
Sep 29 22:49:57 dist-test-slave-00d6 krb5kdc[1506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722197, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:57.884022 1519 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:49:57.884438 1519 webserver.cc:460] Webserver started at http://127.12.27.190:45357/ using document root <none> and password file <none>
I20260929 22:49:57.884696 1519 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:57.884743 1519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:57.884918 1519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:57.885934 1519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "1b1adcc1f6a94e0b9e7ec8b042551490"
format_stamp: "Formatted at 2026-09-29 22:49:57 on dist-test-slave-00d6"
server_key: "014281b706b29b092efc99bc972253a0"
server_key_iv: "06d89dd4864aaf07f4f77fc368cb4db1"
server_key_version: "encryptionkey@0"
I20260929 22:49:57.886284 1519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "1b1adcc1f6a94e0b9e7ec8b042551490"
format_stamp: "Formatted at 2026-09-29 22:49:57 on dist-test-slave-00d6"
server_key: "014281b706b29b092efc99bc972253a0"
server_key_iv: "06d89dd4864aaf07f4f77fc368cb4db1"
server_key_version: "encryptionkey@0"
I20260929 22:49:57.887537 1519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:49:57.888288 1534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:57.888455 1519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:49:57.888552 1519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "1b1adcc1f6a94e0b9e7ec8b042551490"
format_stamp: "Formatted at 2026-09-29 22:49:57 on dist-test-slave-00d6"
server_key: "014281b706b29b092efc99bc972253a0"
server_key_iv: "06d89dd4864aaf07f4f77fc368cb4db1"
server_key_version: "encryptionkey@0"
I20260929 22:49:57.888648 1519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:57.909790 1519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:57.911674 1519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:57.911845 1519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:57.915570 1519 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:46393
I20260929 22:49:57.915609 1586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:46393 every 8 connection(s)
I20260929 22:49:57.916011 1519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:57.916812 1587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:57.919049 1587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490: Bootstrap starting.
I20260929 22:49:57.919660 1587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:57.919955 1587 log.cc:824] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:57.920622 1587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490: No bootstrap required, opened a new log
I20260929 22:49:57.922168 1587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46393 } }
I20260929 22:49:57.922336 1587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:57.922413 1587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1adcc1f6a94e0b9e7ec8b042551490, State: Initialized, Role: FOLLOWER
I20260929 22:49:57.922569 1587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46393 } }
I20260929 22:49:57.922657 1587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:57.922701 1587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:57.922751 1587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:57.923530 1587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46393 } }
I20260929 22:49:57.923678 1587 leader_election.cc:302] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b1adcc1f6a94e0b9e7ec8b042551490; no voters:
I20260929 22:49:57.923864 1587 leader_election.cc:288] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:57.923893 1590 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:57.924069 1590 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [term 1 LEADER]: Becoming Leader. State: Replica: 1b1adcc1f6a94e0b9e7ec8b042551490, State: Running, Role: LEADER
I20260929 22:49:57.924152 1587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:57.924211 1590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46393 } }
I20260929 22:49:57.924662 1591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46393 } } }
I20260929 22:49:57.924763 1591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:57.924662 1592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b1adcc1f6a94e0b9e7ec8b042551490. Latest consensus state: current_term: 1 leader_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1adcc1f6a94e0b9e7ec8b042551490" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46393 } } }
I20260929 22:49:57.924981 1599 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:57.925004 1592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:57.925530 1599 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:57.926000 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1519
I20260929 22:49:57.926132 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:57.926340 12398 external_mini_cluster.cc:1428] Setting key 2b68ab9d2c98b12304d6b396bd08798a
I20260929 22:49:57.927098 1599 catalog_manager.cc:1347] Generated new cluster ID: d6a18be757eb49b59d3b3b6f1f9fa92b
I20260929 22:49:57.927155 1599 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:49:57 dist-test-slave-00d6 krb5kdc[1506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:49:57.936491 1610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:57.926963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36873 (local address 127.12.27.190:46393)
0929 22:49:57.927747 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:57.927754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:57.927780 (+ 26us) server_negotiation.cc:407] Connection header received
0929 22:49:57.927869 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:57.927874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:57.927915 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:57.928051 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:57.928665 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:57.929594 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:57.930353 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:57.930769 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:57.930884 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:57.933242 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:57.933246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:57.933246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:57.933264 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:57.934923 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:57.935313 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:57.935323 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:57.935323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:57.935412 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:57.935687 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:57.935687 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:57.935688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:57.935905 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:57.936082 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:57.936192 (+ 110us) server_negotiation.cc:299] Negotiation successful
0929 22:49:57.936295 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":77,"threads_started":1}
I20260929 22:49:57.937484 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:57.940178 1599 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:57.940857 1599 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:57.945269 1610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:57.939080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60385 (local address 127.12.27.190:46393)
0929 22:49:57.939118 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:57.939119 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:57.939128 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:49:57.939188 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:57.939189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:57.939198 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:57.939240 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:57.939814 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:57.940416 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:57.941161 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:57.941383 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:57.941468 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:57.942636 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:57.942638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:57.942638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:49:57.942645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:57.944081 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:57.944456 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:57.944457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:57.944458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:57.944510 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:49:57.944741 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:49:57.944743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:49:57.944743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:49:57.944852 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:57.944959 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:57.945084 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 22:49:57.945155 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:49:57.952574 1599 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b1adcc1f6a94e0b9e7ec8b042551490: Generated new TSK 0
I20260929 22:49:57.952768 1599 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:57.958835 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1519
W20260929 22:49:57.962939 1504 connection.cc:535] client connection to 127.12.27.190:46393 recv error: Network error: failed to read from TLS socket (remote: 127.12.27.190:46393): Connection reset by peer (error 104)
2026-09-29T22:49:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1316 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:58 dist-test-slave-00d6 krb5kdc[1618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:58 dist-test-slave-00d6 krb5kdc[1618](info): set up 2 sockets
Sep 29 22:49:58 dist-test-slave-00d6 krb5kdc[1618](info): commencing operation
krb5kdc: starting...
W20260929 22:49:59.000295 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:49:59 dist-test-slave-00d6 krb5kdc[1618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:49:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:49:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:49:59.119375 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:37491
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:37491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:49:59.201139 1631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:49:59.201341 1631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:49:59.201364 1631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:49:59.202499 1631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:49:59.202544 1631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:49:59.202558 1631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:49:59.202571 1631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:49:59.202620 1631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:49:59.204116 1631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:37491
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:37491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:49:59.204367 1631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:49:59.204607 1631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:49:59.209446 1639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:59.209559 1637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:49:59.209486 1636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:49:59.209638 1631 server_base.cc:1034] running on GCE node
I20260929 22:49:59.209859 1631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:49:59.210093 1631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:49:59.211234 1631 hybrid_clock.cc:648] HybridClock initialized: now 1790722199211223 us; error 32 us; skew 500 ppm
Sep 29 22:49:59 dist-test-slave-00d6 krb5kdc[1618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722199, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:49:59.216952 1631 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:49:59.217404 1631 webserver.cc:460] Webserver started at http://127.12.27.190:38177/ using document root <none> and password file <none>
I20260929 22:49:59.217581 1631 fs_manager.cc:359] Metadata directory not provided
I20260929 22:49:59.217620 1631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:49:59.217710 1631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:49:59.218703 1631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "f006f91f727948e69489087ea469ddb3"
format_stamp: "Formatted at 2026-09-29 22:49:59 on dist-test-slave-00d6"
server_key: "ba954693360685de353629dd408be8b7"
server_key_iv: "a2815b9305f2fa8fdf872bb439f33c30"
server_key_version: "encryptionkey@0"
I20260929 22:49:59.219002 1631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "f006f91f727948e69489087ea469ddb3"
format_stamp: "Formatted at 2026-09-29 22:49:59 on dist-test-slave-00d6"
server_key: "ba954693360685de353629dd408be8b7"
server_key_iv: "a2815b9305f2fa8fdf872bb439f33c30"
server_key_version: "encryptionkey@0"
I20260929 22:49:59.220353 1631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:49:59.221086 1646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:49:59.221279 1631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:49:59.221385 1631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "f006f91f727948e69489087ea469ddb3"
format_stamp: "Formatted at 2026-09-29 22:49:59 on dist-test-slave-00d6"
server_key: "ba954693360685de353629dd408be8b7"
server_key_iv: "a2815b9305f2fa8fdf872bb439f33c30"
server_key_version: "encryptionkey@0"
I20260929 22:49:59.221462 1631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:49:59.230130 1631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:49:59.232467 1631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:49:59.232623 1631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:49:59.236546 1631 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:37491
I20260929 22:49:59.236608 1698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:37491 every 8 connection(s)
I20260929 22:49:59.236943 1631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:49:59.237792 1699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:49:59.240163 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3: Bootstrap starting.
I20260929 22:49:59.240743 1699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3: Neither blocks nor log segments found. Creating new log.
I20260929 22:49:59.241086 1699 log.cc:824] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3: Log is configured to *not* fsync() on all Append() calls
I20260929 22:49:59.241729 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3: No bootstrap required, opened a new log
I20260929 22:49:59.243296 1699 raft_consensus.cc:348] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f006f91f727948e69489087ea469ddb3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37491 } }
I20260929 22:49:59.243430 1699 raft_consensus.cc:374] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:49:59.243461 1699 raft_consensus.cc:729] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f006f91f727948e69489087ea469ddb3, State: Initialized, Role: FOLLOWER
I20260929 22:49:59.243562 1699 consensus_queue.cc:260] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f006f91f727948e69489087ea469ddb3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37491 } }
I20260929 22:49:59.243615 1699 raft_consensus.cc:388] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:49:59.243713 1699 raft_consensus.cc:482] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:49:59.243750 1699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:49:59.244146 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1631
I20260929 22:49:59.244283 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:49:59.244506 12398 external_mini_cluster.cc:1428] Setting key 90bf6cb91c2caff41f1c03f76aa1c29d
I20260929 22:49:59.244823 1699 raft_consensus.cc:504] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f006f91f727948e69489087ea469ddb3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37491 } }
I20260929 22:49:59.244944 1699 leader_election.cc:302] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f006f91f727948e69489087ea469ddb3; no voters:
I20260929 22:49:59.245154 1699 leader_election.cc:288] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:49:59.245210 1704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:49:59.245344 1704 raft_consensus.cc:686] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [term 1 LEADER]: Becoming Leader. State: Replica: f006f91f727948e69489087ea469ddb3, State: Running, Role: LEADER
I20260929 22:49:59.245467 1704 consensus_queue.cc:237] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f006f91f727948e69489087ea469ddb3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37491 } }
I20260929 22:49:59.245474 1699 sys_catalog.cc:564] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:49:59.246636 1705 sys_catalog.cc:455] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f006f91f727948e69489087ea469ddb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f006f91f727948e69489087ea469ddb3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37491 } } }
I20260929 22:49:59.246740 1705 sys_catalog.cc:458] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:59.247042 1706 sys_catalog.cc:455] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f006f91f727948e69489087ea469ddb3. Latest consensus state: current_term: 1 leader_uuid: "f006f91f727948e69489087ea469ddb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f006f91f727948e69489087ea469ddb3" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 37491 } } }
I20260929 22:49:59.247186 1706 sys_catalog.cc:458] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3 [sys.catalog]: This master's current role is: LEADER
I20260929 22:49:59.247210 1718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:49:59.247745 1718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:49:59.249336 1718 catalog_manager.cc:1347] Generated new cluster ID: 058e37fdb0a6452fb8a6b47c6f3ee550
I20260929 22:49:59.249389 1718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:49:59.251782 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:59.245024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58655 (local address 127.12.27.190:37491)
0929 22:49:59.245242 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:59.245252 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:59.245290 (+ 38us) server_negotiation.cc:407] Connection header received
0929 22:49:59.245407 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:59.245414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:59.245469 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:59.245630 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:59.245876 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:59.247299 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:59.248415 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:59.249020 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:59.249144 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:59.249847 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:59.249851 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:59.249851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:59.251233 (+ 1382us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:59.251274 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:59.251290 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:59.251385 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:59.251478 (+ 93us) server_negotiation.cc:299] Negotiation successful
0929 22:49:59.251509 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":98,"threads_started":1}
I20260929 22:49:59.252895 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:49:59.258023 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:49:59.254490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46877 (local address 127.12.27.190:37491)
0929 22:49:59.254524 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:49:59.254526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:49:59.254533 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:49:59.254598 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:49:59.254599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:49:59.254608 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:49:59.254662 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:49:59.254812 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:59.255545 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:59.256627 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:49:59.256945 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:49:59.257010 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:49:59.257761 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:49:59.257762 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:49:59.257763 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:49:59.257767 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:49:59.257781 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:49:59.257785 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:49:59.257845 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 22:49:59.257938 (+ 93us) server_negotiation.cc:299] Negotiation successful
0929 22:49:59.257950 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:49:59.269505 1718 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:49:59.270076 1718 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:49:59.273510 1718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f006f91f727948e69489087ea469ddb3: Generated new TSK 0
I20260929 22:49:59.273747 1718 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:49:59.282269 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1631
W20260929 22:49:59.286501 1616 connection.cc:535] client connection to 127.12.27.190:37491 recv error: Network error: failed to read from TLS socket (remote: 127.12.27.190:37491): Connection reset by peer (error 104)
2026-09-29T22:49:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:49:59 dist-test-slave-00d6 krb5kdc[1730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:49:59 dist-test-slave-00d6 krb5kdc[1730](info): set up 2 sockets
Sep 29 22:49:59 dist-test-slave-00d6 krb5kdc[1730](info): commencing operation
krb5kdc: starting...
W20260929 22:50:00.344138 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:50:00 dist-test-slave-00d6 krb5kdc[1730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:50:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:50:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:50:00.462191 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40519
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:37267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:40519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:50:00.542037 1743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:00.542251 1743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:00.542275 1743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:00.543339 1743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:00.543373 1743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:00.543387 1743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:00.543401 1743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:00.543412 1743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:00.544865 1743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:37267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:40519
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:40519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:00.545043 1743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:00.545220 1743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:00.550189 1749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:00.550189 1751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:00.550238 1748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:00.550451 1743 server_base.cc:1034] running on GCE node
I20260929 22:50:00.550678 1743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:00.550913 1743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:00.552047 1743 hybrid_clock.cc:648] HybridClock initialized: now 1790722200552034 us; error 28 us; skew 500 ppm
Sep 29 22:50:00 dist-test-slave-00d6 krb5kdc[1730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722200, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:00.554435 1743 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:50:00.554936 1743 webserver.cc:460] Webserver started at http://127.12.27.190:45893/ using document root <none> and password file <none>
I20260929 22:50:00.555186 1743 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:00.555254 1743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:00.555410 1743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:00.556550 1743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "c7d2f87ec7bc4a11942246fd496d2a0e"
format_stamp: "Formatted at 2026-09-29 22:50:00 on dist-test-slave-00d6"
server_key: "1540f2c8dd3e2c8452af1518ec63e01a"
server_key_iv: "d36efcd1a1cea48c56aa5f665cc4d8cd"
server_key_version: "encryptionkey@0"
I20260929 22:50:00.556910 1743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "c7d2f87ec7bc4a11942246fd496d2a0e"
format_stamp: "Formatted at 2026-09-29 22:50:00 on dist-test-slave-00d6"
server_key: "1540f2c8dd3e2c8452af1518ec63e01a"
server_key_iv: "d36efcd1a1cea48c56aa5f665cc4d8cd"
server_key_version: "encryptionkey@0"
I20260929 22:50:00.558198 1743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:50:00.558915 1758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:00.559079 1743 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:50:00.559197 1743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "c7d2f87ec7bc4a11942246fd496d2a0e"
format_stamp: "Formatted at 2026-09-29 22:50:00 on dist-test-slave-00d6"
server_key: "1540f2c8dd3e2c8452af1518ec63e01a"
server_key_iv: "d36efcd1a1cea48c56aa5f665cc4d8cd"
server_key_version: "encryptionkey@0"
I20260929 22:50:00.559285 1743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:00.562562 1743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:00.564455 1743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:00.564616 1743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:00.568626 1743 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:40519
I20260929 22:50:00.568655 1811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:40519 every 8 connection(s)
I20260929 22:50:00.568990 1743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:50:00.569965 1812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:00.572306 1812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e: Bootstrap starting.
I20260929 22:50:00.572860 1812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:00.573093 1812 log.cc:824] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:00.573767 1812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e: No bootstrap required, opened a new log
I20260929 22:50:00.575276 1812 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40519 } }
I20260929 22:50:00.575412 1812 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:50:00.575433 1812 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d2f87ec7bc4a11942246fd496d2a0e, State: Initialized, Role: FOLLOWER
I20260929 22:50:00.575536 1812 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40519 } }
I20260929 22:50:00.575584 1812 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:50:00.575605 1812 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:50:00.575703 1812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:00.576484 1812 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40519 } }
I20260929 22:50:00.576615 1812 leader_election.cc:302] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7d2f87ec7bc4a11942246fd496d2a0e; no voters:
I20260929 22:50:00.576756 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1743
I20260929 22:50:00.576846 1812 leader_election.cc:288] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:50:00.576872 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:50:00.576885 1815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:50:00.577052 1815 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [term 1 LEADER]: Becoming Leader. State: Replica: c7d2f87ec7bc4a11942246fd496d2a0e, State: Running, Role: LEADER
I20260929 22:50:00.577111 12398 external_mini_cluster.cc:1428] Setting key 3f6ad8e2f71406ae78853f32c649ca30
I20260929 22:50:00.577188 1812 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:00.577200 1815 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40519 } }
I20260929 22:50:00.577734 1815 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7d2f87ec7bc4a11942246fd496d2a0e. Latest consensus state: current_term: 1 leader_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40519 } } }
I20260929 22:50:00.577865 1815 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:00.578097 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d2f87ec7bc4a11942246fd496d2a0e" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 40519 } } }
I20260929 22:50:00.578243 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:00.580071 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:00.577549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42589 (local address 127.12.27.190:40519)
0929 22:50:00.578045 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:00.578056 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:00.578106 (+ 50us) server_negotiation.cc:407] Connection header received
0929 22:50:00.578264 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:00.578271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:00.578323 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:00.578464 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:00.579538 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:00.579541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:00.579541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:50:00.579546 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:00.579598 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:50:00.579614 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:00.579721 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:00.579807 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 22:50:00.579848 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":56,"threads_started":1}
W20260929 22:50:00.580134 1832 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:00.580289 1832 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:50:00.580339 1826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:50:00.580505 1826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:50:00.582007 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:50:00.582443 1826 catalog_manager.cc:1347] Generated new cluster ID: 4c06e68ae505422aa28c0229b8ec4058
I20260929 22:50:00.582482 1826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:50:00.591602 1826 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:50:00.591784 1826 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:50:00.592586 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:00.588091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46445 (local address 127.12.27.190:40519)
0929 22:50:00.588132 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:00.588134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:00.591279 (+ 3145us) server_negotiation.cc:407] Connection header received
0929 22:50:00.591497 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:00.591498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:00.591515 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:00.591581 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:00.592350 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:00.592351 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:00.592351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:50:00.592356 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:00.592371 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:50:00.592375 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:00.592432 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:00.592489 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 22:50:00.592504 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:50:00.602412 1826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7d2f87ec7bc4a11942246fd496d2a0e: Generated new TSK 0
I20260929 22:50:00.602653 1826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:50:00.609334 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1743
2026-09-29T22:50:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1326 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:50:00 dist-test-slave-00d6 krb5kdc[1843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:50:00 dist-test-slave-00d6 krb5kdc[1843](info): set up 2 sockets
Sep 29 22:50:00 dist-test-slave-00d6 krb5kdc[1843](info): commencing operation
krb5kdc: starting...
W20260929 22:50:01.640363 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:50:01 dist-test-slave-00d6 krb5kdc[1843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:50:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:50:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:50:01.759265 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46453
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:46453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:50:01.842204 1856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:01.842407 1856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:01.842429 1856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:01.843602 1856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:01.843677 1856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:01.843693 1856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:01.843750 1856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:01.843775 1856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:01.845388 1856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:46453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:46453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:01.845649 1856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:01.845890 1856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:01.850813 1862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:01.850862 1861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:01.850885 1856 server_base.cc:1034] running on GCE node
W20260929 22:50:01.850858 1864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:01.851212 1856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:01.851464 1856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:01.852638 1856 hybrid_clock.cc:648] HybridClock initialized: now 1790722201852610 us; error 56 us; skew 500 ppm
Sep 29 22:50:01 dist-test-slave-00d6 krb5kdc[1843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722201, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:01.855106 1856 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:50:01.855561 1856 webserver.cc:460] Webserver started at http://127.12.27.190:33427/ using document root <none> and password file <none>
I20260929 22:50:01.855821 1856 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:01.855868 1856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:01.855958 1856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:01.856946 1856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "61478f4645284b3e95eb4aeb591a1720"
format_stamp: "Formatted at 2026-09-29 22:50:01 on dist-test-slave-00d6"
server_key: "85c80c91ae36ea16d039c0dda3d3b1cd"
server_key_iv: "0701419a2e68ee5a7b95749e57a15875"
server_key_version: "encryptionkey@0"
I20260929 22:50:01.857239 1856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "61478f4645284b3e95eb4aeb591a1720"
format_stamp: "Formatted at 2026-09-29 22:50:01 on dist-test-slave-00d6"
server_key: "85c80c91ae36ea16d039c0dda3d3b1cd"
server_key_iv: "0701419a2e68ee5a7b95749e57a15875"
server_key_version: "encryptionkey@0"
I20260929 22:50:01.858502 1856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 22:50:01.859198 1871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:01.859390 1856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:50:01.859473 1856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "61478f4645284b3e95eb4aeb591a1720"
format_stamp: "Formatted at 2026-09-29 22:50:01 on dist-test-slave-00d6"
server_key: "85c80c91ae36ea16d039c0dda3d3b1cd"
server_key_iv: "0701419a2e68ee5a7b95749e57a15875"
server_key_version: "encryptionkey@0"
I20260929 22:50:01.859527 1856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:01.872247 1856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:01.874696 1856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:01.874802 1856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:01.878400 1856 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:46453
I20260929 22:50:01.878453 1923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:46453 every 8 connection(s)
I20260929 22:50:01.878808 1856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:50:01.879750 1924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:01.882001 1924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720: Bootstrap starting.
I20260929 22:50:01.882586 1924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:01.882899 1924 log.cc:824] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:01.883572 1924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720: No bootstrap required, opened a new log
I20260929 22:50:01.883883 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1856
I20260929 22:50:01.883970 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:50:01.884202 12398 external_mini_cluster.cc:1428] Setting key afe226bb841cc03cfa13eaf789f99be7
I20260929 22:50:01.885907 1924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61478f4645284b3e95eb4aeb591a1720" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46453 } }
I20260929 22:50:01.886087 1924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:50:01.886127 1924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61478f4645284b3e95eb4aeb591a1720, State: Initialized, Role: FOLLOWER
I20260929 22:50:01.886268 1924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61478f4645284b3e95eb4aeb591a1720" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46453 } }
I20260929 22:50:01.886348 1924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:50:01.886370 1924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:50:01.886442 1924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:01.887776 1924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61478f4645284b3e95eb4aeb591a1720" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46453 } }
I20260929 22:50:01.887897 1924 leader_election.cc:302] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61478f4645284b3e95eb4aeb591a1720; no voters:
I20260929 22:50:01.888059 1924 leader_election.cc:288] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:50:01.888137 1929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:50:01.888278 1929 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [term 1 LEADER]: Becoming Leader. State: Replica: 61478f4645284b3e95eb4aeb591a1720, State: Running, Role: LEADER
I20260929 22:50:01.888302 1924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:01.888363 1929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61478f4645284b3e95eb4aeb591a1720" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46453 } }
I20260929 22:50:01.888731 1929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61478f4645284b3e95eb4aeb591a1720. Latest consensus state: current_term: 1 leader_uuid: "61478f4645284b3e95eb4aeb591a1720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61478f4645284b3e95eb4aeb591a1720" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46453 } } }
I20260929 22:50:01.888823 1929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:01.888741 1930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61478f4645284b3e95eb4aeb591a1720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61478f4645284b3e95eb4aeb591a1720" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 46453 } } }
I20260929 22:50:01.888952 1930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:01.889070 1937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:50:01.889613 1937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:50:01.891607 1937 catalog_manager.cc:1347] Generated new cluster ID: a1b899699dab4e7aadc4ac05ff8ae8db
I20260929 22:50:01.891686 1937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 22:50:01 dist-test-slave-00d6 krb5kdc[1843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:01.896461 1937 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:50:01.897141 1937 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:50:01.898584 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:01.884726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50783 (local address 127.12.27.190:46453)
0929 22:50:01.884925 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:01.884935 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:01.884973 (+ 38us) server_negotiation.cc:407] Connection header received
0929 22:50:01.885869 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:01.885878 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:01.885945 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:01.886103 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:01.886904 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:01.889392 (+ 2488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:01.891150 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:01.891805 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:01.891922 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:01.894823 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:01.894828 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:01.894828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:01.894842 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:01.896946 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:01.897351 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:01.897355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:01.897355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:01.897456 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:01.897684 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:01.897685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:01.897685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:01.897909 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:01.898084 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:01.898165 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 22:50:01.898421 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
I20260929 22:50:01.899467 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:50:01.907132 1937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61478f4645284b3e95eb4aeb591a1720: Generated new TSK 0
I20260929 22:50:01.907305 1937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:50:01.907539 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:01.900918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58275 (local address 127.12.27.190:46453)
0929 22:50:01.900964 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:01.900966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:01.901101 (+ 135us) server_negotiation.cc:407] Connection header received
0929 22:50:01.901212 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:01.901213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:01.901222 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:01.901268 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:01.901773 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:01.902299 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:01.903070 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:01.903303 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:01.903376 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:01.904620 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:01.904622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:01.904622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:01.904629 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:01.906107 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:01.906592 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:01.906593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:01.906593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:01.906641 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:01.906860 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:01.906862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:01.906862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:01.906998 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:01.907104 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:01.907361 (+ 257us) server_negotiation.cc:299] Negotiation successful
0929 22:50:01.907443 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 22:50:01.909399 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1856
2026-09-29T22:50:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1300 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:50:01 dist-test-slave-00d6 krb5kdc[1955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:50:01 dist-test-slave-00d6 krb5kdc[1955](info): set up 2 sockets
Sep 29 22:50:01 dist-test-slave-00d6 krb5kdc[1955](info): commencing operation
krb5kdc: starting...
W20260929 22:50:02.988345 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:50:03 dist-test-slave-00d6 krb5kdc[1955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:50:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:50:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:50:03.106820 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:34075
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:34075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:50:03.187994 1968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:03.188241 1968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:03.188279 1968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:03.189441 1968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:03.189517 1968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:03.189541 1968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:03.189563 1968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:03.189591 1968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:03.191123 1968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:34075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:34075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:03.191396 1968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:03.191654 1968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:03.196605 1973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:03.196612 1974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:03.196698 1976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:03.196643 1968 server_base.cc:1034] running on GCE node
I20260929 22:50:03.197017 1968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:03.197319 1968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:03.198462 1968 hybrid_clock.cc:648] HybridClock initialized: now 1790722203198442 us; error 40 us; skew 500 ppm
Sep 29 22:50:03 dist-test-slave-00d6 krb5kdc[1955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722203, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:03.200984 1968 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:50:03.201377 1968 webserver.cc:460] Webserver started at http://127.12.27.190:38043/ using document root <none> and password file <none>
I20260929 22:50:03.201630 1968 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:03.201676 1968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:03.201766 1968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:03.202778 1968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "2016e2ea5b1547cfa7345550d45fd56c"
format_stamp: "Formatted at 2026-09-29 22:50:03 on dist-test-slave-00d6"
server_key: "d6099b0fabaeaa73d92fe6f699b279b0"
server_key_iv: "d34b3388eada2e137c8e5fe7b31a1df2"
server_key_version: "encryptionkey@0"
I20260929 22:50:03.203082 1968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "2016e2ea5b1547cfa7345550d45fd56c"
format_stamp: "Formatted at 2026-09-29 22:50:03 on dist-test-slave-00d6"
server_key: "d6099b0fabaeaa73d92fe6f699b279b0"
server_key_iv: "d34b3388eada2e137c8e5fe7b31a1df2"
server_key_version: "encryptionkey@0"
I20260929 22:50:03.204767 1968 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260929 22:50:03.205570 1983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:03.205818 1968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 22:50:03.205929 1968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "2016e2ea5b1547cfa7345550d45fd56c"
format_stamp: "Formatted at 2026-09-29 22:50:03 on dist-test-slave-00d6"
server_key: "d6099b0fabaeaa73d92fe6f699b279b0"
server_key_iv: "d34b3388eada2e137c8e5fe7b31a1df2"
server_key_version: "encryptionkey@0"
I20260929 22:50:03.206010 1968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:03.223188 1968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:03.225261 1968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:03.225426 1968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:03.229441 1968 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:34075
I20260929 22:50:03.229485 2035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:34075 every 8 connection(s)
I20260929 22:50:03.229861 1968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:50:03.230752 2036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:03.231979 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 1968
I20260929 22:50:03.232103 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:50:03.232297 12398 external_mini_cluster.cc:1428] Setting key fc23b12581848059f305ccdcb398539a
I20260929 22:50:03.233749 2036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c: Bootstrap starting.
I20260929 22:50:03.234462 2036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:03.234784 2036 log.cc:824] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:03.235528 2036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c: No bootstrap required, opened a new log
I20260929 22:50:03.237707 2036 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2016e2ea5b1547cfa7345550d45fd56c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 34075 } }
I20260929 22:50:03.237895 2036 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:50:03.237933 2036 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2016e2ea5b1547cfa7345550d45fd56c, State: Initialized, Role: FOLLOWER
I20260929 22:50:03.238119 2036 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2016e2ea5b1547cfa7345550d45fd56c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 34075 } }
I20260929 22:50:03.238302 2036 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:50:03.238370 2036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:50:03.238415 2036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:03.238457 2039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:03.232869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36773 (local address 127.12.27.190:34075)
0929 22:50:03.233070 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:03.233079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:03.233115 (+ 36us) server_negotiation.cc:407] Connection header received
0929 22:50:03.233647 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:03.233656 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:03.233732 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:03.233888 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:03.234091 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:03.235447 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:03.236279 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:03.236922 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:03.237044 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:03.237668 (+ 624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:03.237672 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:03.237672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:50:03.237878 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:03.237919 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:50:03.237934 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:03.238009 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:03.238101 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 22:50:03.238168 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":85,"threads_started":1}
I20260929 22:50:03.238947 2036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2016e2ea5b1547cfa7345550d45fd56c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 34075 } }
I20260929 22:50:03.239063 2036 leader_election.cc:302] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2016e2ea5b1547cfa7345550d45fd56c; no voters:
I20260929 22:50:03.239255 2036 leader_election.cc:288] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:50:03.239287 2041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:50:03.239435 2041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [term 1 LEADER]: Becoming Leader. State: Replica: 2016e2ea5b1547cfa7345550d45fd56c, State: Running, Role: LEADER
I20260929 22:50:03.239511 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:50:03.239522 2041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2016e2ea5b1547cfa7345550d45fd56c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 34075 } }
I20260929 22:50:03.239545 2036 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:03.239835 2041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2016e2ea5b1547cfa7345550d45fd56c. Latest consensus state: current_term: 1 leader_uuid: "2016e2ea5b1547cfa7345550d45fd56c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2016e2ea5b1547cfa7345550d45fd56c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 34075 } } }
I20260929 22:50:03.239917 2041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:03.239845 2043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2016e2ea5b1547cfa7345550d45fd56c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2016e2ea5b1547cfa7345550d45fd56c" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 34075 } } }
I20260929 22:50:03.240155 2043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:03.240269 2047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:50:03.240777 2047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:50:03.244391 2039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:03.241155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59459 (local address 127.12.27.190:34075)
0929 22:50:03.241223 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:03.241225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:03.241351 (+ 126us) server_negotiation.cc:407] Connection header received
0929 22:50:03.241448 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:03.241449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:03.241459 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:03.241486 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:03.241671 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:03.242189 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:03.243156 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:03.243341 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:03.243390 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:03.244136 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:03.244138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:03.244138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:50:03.244143 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:03.244157 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:50:03.244161 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:03.244190 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:03.244296 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 22:50:03.244321 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 22:50:03.244782 2047 catalog_manager.cc:1347] Generated new cluster ID: 5285246efb944bb39257c078f66fcd4e
I20260929 22:50:03.244833 2047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:50:03.244887 2063 mvcc.cc:205] Tried to move back new op lower bound from 7334798144478031872 to 7334798144469381120. Current Snapshot: MvccSnapshot[applied={T|T < 7334798144478031872 or (T in {7334798144478031872})}]
I20260929 22:50:03.272639 2047 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:50:03.273425 2047 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:50:03.279153 2047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2016e2ea5b1547cfa7345550d45fd56c: Generated new TSK 0
I20260929 22:50:03.279368 2047 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:50:03.284394 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 1968
2026-09-29T22:50:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1375 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:50:03 dist-test-slave-00d6 krb5kdc[2067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:50:03 dist-test-slave-00d6 krb5kdc[2067](info): set up 2 sockets
Sep 29 22:50:03 dist-test-slave-00d6 krb5kdc[2067](info): commencing operation
krb5kdc: starting...
W20260929 22:50:04.328351 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:50:04 dist-test-slave-00d6 krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:50:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:50:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:50:04.448679 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:42063
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:33299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:42063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:50:04.529036 2080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:04.529250 2080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:04.529273 2080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:04.530470 2080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:04.530515 2080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:04.530530 2080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:04.530543 2080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:04.530555 2080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:04.532070 2080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:33299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:42063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:42063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:04.532332 2080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:04.532560 2080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:04.537388 2086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:04.537369 2085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:04.537346 2088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:04.537442 2080 server_base.cc:1034] running on GCE node
I20260929 22:50:04.537799 2080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:04.538040 2080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:04.539186 2080 hybrid_clock.cc:648] HybridClock initialized: now 1790722204539164 us; error 34 us; skew 500 ppm
Sep 29 22:50:04 dist-test-slave-00d6 krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:04.545493 2080 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:50:04.545985 2080 webserver.cc:460] Webserver started at http://127.12.27.190:37943/ using document root <none> and password file <none>
I20260929 22:50:04.546221 2080 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:04.546293 2080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:04.546446 2080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:04.547521 2080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "b4024a2c9e5947c0b66e51d7e4a9e200"
format_stamp: "Formatted at 2026-09-29 22:50:04 on dist-test-slave-00d6"
server_key: "6fc33bea0815b1d2e32413645dec9d93"
server_key_iv: "70ee6572e0b73c5294d77692a9f27c77"
server_key_version: "encryptionkey@0"
I20260929 22:50:04.547971 2080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "b4024a2c9e5947c0b66e51d7e4a9e200"
format_stamp: "Formatted at 2026-09-29 22:50:04 on dist-test-slave-00d6"
server_key: "6fc33bea0815b1d2e32413645dec9d93"
server_key_iv: "70ee6572e0b73c5294d77692a9f27c77"
server_key_version: "encryptionkey@0"
I20260929 22:50:04.549309 2080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:50:04.550021 2095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:04.550230 2080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:50:04.550338 2080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "b4024a2c9e5947c0b66e51d7e4a9e200"
format_stamp: "Formatted at 2026-09-29 22:50:04 on dist-test-slave-00d6"
server_key: "6fc33bea0815b1d2e32413645dec9d93"
server_key_iv: "70ee6572e0b73c5294d77692a9f27c77"
server_key_version: "encryptionkey@0"
I20260929 22:50:04.550414 2080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:04.553838 2080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:04.555946 2080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:04.556109 2080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:04.560586 2080 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:42063
I20260929 22:50:04.560624 2147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:42063 every 8 connection(s)
I20260929 22:50:04.560992 2080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:50:04.562017 2148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:04.563140 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2080
I20260929 22:50:04.563226 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:50:04.563412 12398 external_mini_cluster.cc:1428] Setting key 45e911c0223f9bf8c90e394e77c6b7b9
I20260929 22:50:04.564909 2148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200: Bootstrap starting.
I20260929 22:50:04.565582 2148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:04.565907 2148 log.cc:824] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:04.566077 2151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:04.563972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60511 (local address 127.12.27.190:42063)
0929 22:50:04.564167 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:04.564176 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:04.564209 (+ 33us) server_negotiation.cc:407] Connection header received
0929 22:50:04.564711 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:04.564720 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:04.564755 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:04.564909 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:04.565596 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:04.565600 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:04.565600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:50:04.565605 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:04.565647 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:50:04.565661 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:04.565768 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:04.565806 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 22:50:04.565846 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":82,"threads_started":1}
I20260929 22:50:04.566689 2148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200: No bootstrap required, opened a new log
I20260929 22:50:04.566958 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:50:04.568917 2148 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42063 } }
I20260929 22:50:04.569161 2148 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 22:50:04.569223 2148 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4024a2c9e5947c0b66e51d7e4a9e200, State: Initialized, Role: FOLLOWER
I20260929 22:50:04.569353 2148 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42063 } }
I20260929 22:50:04.569520 2148 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 22:50:04.569590 2151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:04.568423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43929 (local address 127.12.27.190:42063)
0929 22:50:04.568462 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:04.568463 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:04.568581 (+ 118us) server_negotiation.cc:407] Connection header received
0929 22:50:04.568661 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:04.568662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:04.568665 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:04.568705 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:04.569299 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:04.569300 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:04.569300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 22:50:04.569304 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:04.569315 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 22:50:04.569341 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:04.569397 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:04.569472 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 22:50:04.569482 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:50:04.569617 2148 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 22:50:04.569674 2148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:04.570346 2148 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42063 } }
I20260929 22:50:04.570461 2148 leader_election.cc:302] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4024a2c9e5947c0b66e51d7e4a9e200; no voters:
I20260929 22:50:04.570624 2148 leader_election.cc:288] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 22:50:04.570643 2158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:50:04.570796 2158 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [term 1 LEADER]: Becoming Leader. State: Replica: b4024a2c9e5947c0b66e51d7e4a9e200, State: Running, Role: LEADER
I20260929 22:50:04.570873 2148 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:04.570917 2158 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42063 } }
I20260929 22:50:04.571316 2159 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4024a2c9e5947c0b66e51d7e4a9e200. Latest consensus state: current_term: 1 leader_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42063 } } }
I20260929 22:50:04.571316 2160 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4024a2c9e5947c0b66e51d7e4a9e200" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42063 } } }
I20260929 22:50:04.571473 2159 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:04.571484 2160 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:04.571731 2167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:50:04.572257 2167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:50:04.573813 2167 catalog_manager.cc:1347] Generated new cluster ID: 0d024eecfc9e4291ad624f5f802e7989
I20260929 22:50:04.573877 2167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:50:04.594178 2167 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:50:04.594384 2167 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:50:04.599408 2167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4024a2c9e5947c0b66e51d7e4a9e200: Generated new TSK 0
I20260929 22:50:04.599627 2167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:50:04.604417 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2080
2026-09-29T22:50:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1319 ms)
[----------] 18 tests from AuthTokenIssuingTest (23738 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:50:04 dist-test-slave-00d6 krb5kdc[2179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:50:04 dist-test-slave-00d6 krb5kdc[2179](info): set up 2 sockets
Sep 29 22:50:04 dist-test-slave-00d6 krb5kdc[2179](info): commencing operation
krb5kdc: starting...
W20260929 22:50:05.640543 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:50:05 dist-test-slave-00d6 krb5kdc[2179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:50:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:50:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:50:05.758601 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:42067
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:42067,127.12.27.189:40749,127.12.27.188:44085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:50:05.841480 2192 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:50:05.841701 2192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:05.841722 2192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:05.841742 2192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:05.842834 2192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:05.842868 2192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:05.842883 2192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:05.842896 2192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:05.842908 2192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:05.844414 2192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:42067,127.12.27.189:40749,127.12.27.188:44085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:42067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:05.844619 2192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:05.844789 2192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:05.849793 2197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:05.849853 2192 server_base.cc:1034] running on GCE node
W20260929 22:50:05.849805 2198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:05.849992 2200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:05.850387 2192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:05.850699 2192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:05.851892 2192 hybrid_clock.cc:648] HybridClock initialized: now 1790722205851880 us; error 46 us; skew 500 ppm
Sep 29 22:50:05 dist-test-slave-00d6 krb5kdc[2179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:05.854486 2192 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:50:05.854981 2192 webserver.cc:460] Webserver started at http://127.12.27.190:41293/ using document root <none> and password file <none>
I20260929 22:50:05.855221 2192 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:05.855289 2192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:05.855443 2192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:05.856590 2192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "fc1b73d3b0434ac2bf7aca129f75e804"
format_stamp: "Formatted at 2026-09-29 22:50:05 on dist-test-slave-00d6"
server_key: "acbd4e46241558812048ad9f1f513a6b"
server_key_iv: "3d6b33d4d89a8f41737f82910e647eb5"
server_key_version: "encryptionkey@0"
I20260929 22:50:05.856950 2192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "fc1b73d3b0434ac2bf7aca129f75e804"
format_stamp: "Formatted at 2026-09-29 22:50:05 on dist-test-slave-00d6"
server_key: "acbd4e46241558812048ad9f1f513a6b"
server_key_iv: "3d6b33d4d89a8f41737f82910e647eb5"
server_key_version: "encryptionkey@0"
I20260929 22:50:05.858320 2192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:50:05.859014 2207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:05.859459 2192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:50:05.859561 2192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "fc1b73d3b0434ac2bf7aca129f75e804"
format_stamp: "Formatted at 2026-09-29 22:50:05 on dist-test-slave-00d6"
server_key: "acbd4e46241558812048ad9f1f513a6b"
server_key_iv: "3d6b33d4d89a8f41737f82910e647eb5"
server_key_version: "encryptionkey@0"
I20260929 22:50:05.859620 2192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:05.878888 2192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:05.881110 2192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:05.881232 2192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:05.885615 2192 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:42067
I20260929 22:50:05.885673 2259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:42067 every 8 connection(s)
I20260929 22:50:05.886039 2192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:50:05.887151 2260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:05.888828 2260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:05.893666 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2192
I20260929 22:50:05.893750 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:50:05.893954 12398 external_mini_cluster.cc:1428] Setting key 8697646c0e3f72ab0a6287b5357b1041
Sep 29 22:50:05 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:05.898973 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:05.889576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36186 (local address 127.12.27.190:42067)
0929 22:50:05.889774 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:05.889779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:05.889867 (+ 88us) server_negotiation.cc:407] Connection header received
0929 22:50:05.890378 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:05.890380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:05.890397 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:05.890485 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:05.890993 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:05.891876 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:05.892732 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:05.893039 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:05.893126 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:05.895611 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:05.895619 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:05.895619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:05.895659 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:05.897375 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:05.897867 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:05.897870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:05.897870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:05.897943 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:05.898228 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:05.898228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:05.898229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:05.898420 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:05.898479 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:05.898727 (+ 248us) server_negotiation.cc:299] Negotiation successful
0929 22:50:05.898817 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":139,"threads_started":1}
I20260929 22:50:05.899118 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:05.889551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:42067 (local address 127.0.0.1:36186)
0929 22:50:05.889724 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:05.889766 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:05.890214 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:05.890509 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:05.890513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:05.890753 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:05.890905 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:05.890909 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:05.891966 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:05.891967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:05.892661 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:05.892663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:05.893129 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:05.893130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:05.893182 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:05.893781 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:05.893790 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:05.895525 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:05.897472 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:05.897480 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:05.897482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:05.897778 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:05.898035 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:05.898036 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:05.898037 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:05.898159 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:05.898492 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:05.898500 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:05.898579 (+ 79us) client_negotiation.cc:769] Sending connection context
0929 22:50:05.898693 (+ 114us) client_negotiation.cc:240] Negotiation successful
0929 22:50:05.898921 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":57,"thread_start_us":97,"threads_started":1}
I20260929 22:50:05.899871 2260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:05.900228 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:05.900088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57486)
0929 22:50:05.900146 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:05.900199 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 22:50:05.900377 2211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
I20260929 22:50:05.900835 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:05.900727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57494)
0929 22:50:05.900776 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:05.900810 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 22:50:05.900969 2260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:40749: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.27.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab.
Entry for principal kudu/127.12.27.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab.
I20260929 22:50:05.919502 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:40749
--webserver_interface=127.12.27.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab
--principal=kudu/127.12.27.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:42067,127.12.27.189:40749,127.12.27.188:44085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:50:05.950208 2260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } attempt: 1
I20260929 22:50:05.950716 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:05.950544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57508)
0929 22:50:05.950623 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:05.950674 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 22:50:05.951135 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:05.951022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57520)
0929 22:50:05.951076 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:05.951109 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 22:50:05.951261 2260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:40749: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
W20260929 22:50:06.001992 2267 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:50:06.002266 2267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:06.002296 2267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:06.002342 2267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:06.003513 2267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:06.003585 2267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:06.003610 2267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:06.003669 2267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:06.003720 2267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:06.005232 2267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:42067,127.12.27.189:40749,127.12.27.188:44085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab
--principal=kudu/127.12.27.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:40749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.27.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:06.005524 2267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:06.005760 2267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:06.010752 2273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:06.010759 2272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:06.010891 2267 server_base.cc:1034] running on GCE node
W20260929 22:50:06.010759 2275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:06.011277 2267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:06.011587 2267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:06.012789 2267 hybrid_clock.cc:648] HybridClock initialized: now 1790722206012772 us; error 40 us; skew 500 ppm
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:06.015221 2267 init.cc:377] Logged in from keytab as kudu/127.12.27.189@KRBTEST.COM (short username kudu)
I20260929 22:50:06.015604 2267 webserver.cc:460] Webserver started at http://127.12.27.189:45739/ using document root <none> and password file <none>
I20260929 22:50:06.015848 2267 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:06.015892 2267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:06.015985 2267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:06.016997 2267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data/instance:
uuid: "a08cbb1c75ff4c11a0ecd85099de4735"
format_stamp: "Formatted at 2026-09-29 22:50:06 on dist-test-slave-00d6"
server_key: "2074d422647f453596db304e64560413"
server_key_iv: "31407927336be809b25be67161489773"
server_key_version: "encryptionkey@0"
I20260929 22:50:06.017300 2267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal/instance:
uuid: "a08cbb1c75ff4c11a0ecd85099de4735"
format_stamp: "Formatted at 2026-09-29 22:50:06 on dist-test-slave-00d6"
server_key: "2074d422647f453596db304e64560413"
server_key_iv: "31407927336be809b25be67161489773"
server_key_version: "encryptionkey@0"
I20260929 22:50:06.018602 2267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 22:50:06.019312 2282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:06.019502 2267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:50:06.019434 2260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } attempt: 2
I20260929 22:50:06.019595 2267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal
uuid: "a08cbb1c75ff4c11a0ecd85099de4735"
format_stamp: "Formatted at 2026-09-29 22:50:06 on dist-test-slave-00d6"
server_key: "2074d422647f453596db304e64560413"
server_key_iv: "31407927336be809b25be67161489773"
server_key_version: "encryptionkey@0"
I20260929 22:50:06.019726 2267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:06.019896 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.019764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57522)
0929 22:50:06.019814 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.019854 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 22:50:06.020255 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.020166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57538)
0929 22:50:06.020209 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.020236 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 22:50:06.020370 2260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:40749: Network error: Client connection negotiation failed: client connection to 127.12.27.189:40749: connect: Connection refused (error 111)
I20260929 22:50:06.031077 2267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:06.033102 2267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:06.033216 2267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:06.037140 2267 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.189:40749
I20260929 22:50:06.037170 2334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.189:40749 every 8 connection(s)
I20260929 22:50:06.037518 2267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
I20260929 22:50:06.038491 2335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:06.040087 2335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:06.044380 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2267
I20260929 22:50:06.044466 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-1/wal/instance
I20260929 22:50:06.044670 12398 external_mini_cluster.cc:1428] Setting key 0a5efe084e556f1fbcf11a644e7c2e39
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:06.049607 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.040800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.12.27.190:42067)
0929 22:50:06.040876 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.040879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.041080 (+ 201us) server_negotiation.cc:407] Connection header received
0929 22:50:06.041527 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.041528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.041541 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.041596 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.042186 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.042673 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.043725 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.043919 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.043977 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.046582 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.046584 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.046584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.046592 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.048204 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.048630 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.048631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.048631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.048692 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.048962 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.048962 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.048963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.049081 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.049154 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.049422 (+ 268us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.049512 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:50:06.049814 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.040755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:42067 (local address 127.0.0.1:36192)
0929 22:50:06.040958 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.041001 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.041425 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.041669 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.041673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.041916 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.042103 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.042107 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.042756 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.042756 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.043564 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.043566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.044013 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.044014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.044120 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.044819 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.044829 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.046485 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.048297 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.048305 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.048307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.048540 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.048759 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.048760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.048760 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.048872 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.049146 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.049153 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.049294 (+ 141us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.049403 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.049569 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":100,"threads_started":1}
I20260929 22:50:06.050482 2335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.27.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.188@KRBTEST.COM" created.
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:50:06.058538 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.050763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57546)
0929 22:50:06.050821 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.050834 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.050884 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.051098 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.051099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.051257 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.051320 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.051323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.052319 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.052320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.052859 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.052861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.053425 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.053426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.053482 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.053835 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.053839 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.055411 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.057422 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.057423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.057423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.057593 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.057830 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.057830 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.057830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.057880 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.058191 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.058191 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.058225 (+ 34us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.058277 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.058378 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 22:50:06.058667 2339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.050807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57546 (local address 127.12.27.189:40749)
0929 22:50:06.050951 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.050956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.050974 (+ 18us) server_negotiation.cc:407] Connection header received
0929 22:50:06.051002 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.051004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.051015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.051074 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.051398 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.052248 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.052961 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.053342 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.053409 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.055526 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.055534 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.055534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.055540 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.057341 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.057689 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.057692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.057693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.057757 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.057936 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.057937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.057937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.058121 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.058206 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.058311 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.058450 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
I20260929 22:50:06.059243 2335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:06.059615 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.059481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36544)
0929 22:50:06.059532 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.059584 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:50:06.059795 2286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
I20260929 22:50:06.060277 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.060181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36554)
0929 22:50:06.060235 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.060260 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260929 22:50:06.060397 2335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44085: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab.
Entry for principal kudu/127.12.27.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab.
I20260929 22:50:06.071410 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:44085
--webserver_interface=127.12.27.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab
--principal=kudu/127.12.27.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:40645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:42067,127.12.27.189:40749,127.12.27.188:44085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:50:06.109638 2335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } attempt: 1
I20260929 22:50:06.110163 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.110021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36560)
0929 22:50:06.110090 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.110134 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 22:50:06.110518 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.110415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36564)
0929 22:50:06.110463 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.110487 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:50:06.110608 2335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44085: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
I20260929 22:50:06.111538 2260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } attempt: 3
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:50:06.119292 2339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.111920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57560 (local address 127.12.27.189:40749)
0929 22:50:06.111985 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.111988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.111999 (+ 11us) server_negotiation.cc:407] Connection header received
0929 22:50:06.112097 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.112098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.112110 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.112159 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.112492 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.112999 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.114161 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.114392 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.114466 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.116486 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.116488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.116488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.116496 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.118055 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.118508 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.118509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.118509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.118571 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.118775 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.118776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.118776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.118893 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.118968 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.119126 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.119199 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 22:50:06.119293 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.111838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57560)
0929 22:50:06.111889 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.111900 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.111985 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.112164 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.112165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.112342 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.112408 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.112409 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.113094 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.113095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.114070 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.114072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.114475 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.114476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.114558 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.115079 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.115084 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.116392 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.118253 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.118255 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.118255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.118432 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.118650 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.118651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.118651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.118712 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.118961 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.118962 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.119008 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.119090 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.119194 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 22:50:06.119685 2260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:06.120061 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.119925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36570)
0929 22:50:06.119974 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.119998 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 22:50:06.120376 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.120284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36576)
0929 22:50:06.120335 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.120357 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260929 22:50:06.120492 2260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44085: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
I20260929 22:50:06.151693 2260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } attempt: 1
I20260929 22:50:06.152266 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.152123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36590)
0929 22:50:06.152190 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.152233 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 22:50:06.152763 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.152632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36598)
0929 22:50:06.152708 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.152739 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260929 22:50:06.152916 2260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44085: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
W20260929 22:50:06.153774 2342 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:50:06.153966 2342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:06.153985 2342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:06.154004 2342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:06.155081 2342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:06.155114 2342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:06.155134 2342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:06.155148 2342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:06.155159 2342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:06.156617 2342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:40645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:42067,127.12.27.189:40749,127.12.27.188:44085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab
--principal=kudu/127.12.27.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:44085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.27.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:06.156809 2342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:06.156972 2342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:06.161614 2348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:06.161610 2350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:06.161610 2347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:06.161975 2342 server_base.cc:1034] running on GCE node
I20260929 22:50:06.162235 2342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:06.162511 2342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:06.163692 2342 hybrid_clock.cc:648] HybridClock initialized: now 1790722206163681 us; error 46 us; skew 500 ppm
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:06.166278 2342 init.cc:377] Logged in from keytab as kudu/127.12.27.188@KRBTEST.COM (short username kudu)
I20260929 22:50:06.166688 2342 webserver.cc:460] Webserver started at http://127.12.27.188:40039/ using document root <none> and password file <none>
I20260929 22:50:06.166870 2342 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:06.166908 2342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:06.167007 2342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:06.168107 2342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data/instance:
uuid: "313476a0e6954d46b9200eff9375588b"
format_stamp: "Formatted at 2026-09-29 22:50:06 on dist-test-slave-00d6"
server_key: "d3376425e813305f66b9f54f3bab0b11"
server_key_iv: "fa5af1182de0b3adb51d11e13faafd62"
server_key_version: "encryptionkey@0"
I20260929 22:50:06.168406 2342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal/instance:
uuid: "313476a0e6954d46b9200eff9375588b"
format_stamp: "Formatted at 2026-09-29 22:50:06 on dist-test-slave-00d6"
server_key: "d3376425e813305f66b9f54f3bab0b11"
server_key_iv: "fa5af1182de0b3adb51d11e13faafd62"
server_key_version: "encryptionkey@0"
I20260929 22:50:06.169677 2342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:50:06.170372 2357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:06.170559 2342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 22:50:06.170650 2342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal
uuid: "313476a0e6954d46b9200eff9375588b"
format_stamp: "Formatted at 2026-09-29 22:50:06 on dist-test-slave-00d6"
server_key: "d3376425e813305f66b9f54f3bab0b11"
server_key_iv: "fa5af1182de0b3adb51d11e13faafd62"
server_key_version: "encryptionkey@0"
I20260929 22:50:06.170727 2342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:06.178767 2335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } attempt: 2
I20260929 22:50:06.179190 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.179043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36610)
0929 22:50:06.179107 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.179153 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:50:06.179543 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.179444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36616)
0929 22:50:06.179492 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.179524 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:50:06.179667 2335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:44085: Network error: Client connection negotiation failed: client connection to 127.12.27.188:44085: connect: Connection refused (error 111)
I20260929 22:50:06.185520 2342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:06.187424 2342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:06.187587 2342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:06.191555 2342 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.188:44085
I20260929 22:50:06.191607 2409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.188:44085 every 8 connection(s)
I20260929 22:50:06.192022 2342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
I20260929 22:50:06.193014 2410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:06.194521 2410 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:06.196156 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2342
I20260929 22:50:06.196261 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790721915685765-12398-0/minicluster-data/master-2/wal/instance
I20260929 22:50:06.196452 12398 external_mini_cluster.cc:1428] Setting key f91d4e0fc2391a754c93df651181213b
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:50:06.204828 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.195276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36196 (local address 127.12.27.190:42067)
0929 22:50:06.195330 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.195332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.195540 (+ 208us) server_negotiation.cc:407] Connection header received
0929 22:50:06.196044 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.196046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.196060 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.196112 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.196860 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.197402 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.198443 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.198648 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.198741 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.201225 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.201226 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.201227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.201237 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.202995 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.203561 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.203563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.203563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.203669 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.204045 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.204046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.204047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.204175 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.204242 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.204617 (+ 375us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.204707 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:50:06.204891 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.195195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:42067 (local address 127.0.0.1:36196)
0929 22:50:06.195371 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.195414 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.195932 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.196200 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.196203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.196542 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.196764 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.196768 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.197518 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.197519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.198336 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.198338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.198774 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.198775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.198894 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.199444 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.199452 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.201125 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.203132 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.203140 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.203142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.203477 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.203755 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.203756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.203756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.203903 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.204259 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.204264 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.204436 (+ 172us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.204551 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.204695 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260929 22:50:06.205454 2410 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:06.206348 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.196909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.12.27.188:44085)
0929 22:50:06.197059 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.197064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.197093 (+ 29us) server_negotiation.cc:407] Connection header received
0929 22:50:06.197152 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.197155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.197175 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.197248 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.197885 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.198602 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.199405 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.199802 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.199884 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.202428 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.202436 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.202436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.202443 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.204476 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.205213 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.205216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.205216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.205303 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.205515 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.205516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.205517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.205843 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.205980 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.206168 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.206253 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:06.212668 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.205731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:40749 (local address 127.0.0.1:57564)
0929 22:50:06.205805 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.205816 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.205861 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.206058 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.206060 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.206250 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.206315 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.206318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.207153 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.207154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.207839 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.207841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.208281 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.208282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.208391 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.208845 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.208850 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.210015 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.211598 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.211598 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.211599 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.211818 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.212041 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.212042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.212042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.212113 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.212340 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.212341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.212384 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.212478 (+ 94us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.212571 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260929 22:50:06.212671 2339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.205889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57564 (local address 127.12.27.189:40749)
0929 22:50:06.205937 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.205939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.205948 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:50:06.205972 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.205973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.205982 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.206036 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.206387 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.207086 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.207966 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.208193 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.208271 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.210100 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.210101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.210101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.210109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.211517 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.211892 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.211893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.211893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.211966 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.212176 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.212177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.212177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.212270 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.212346 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.212504 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.212574 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 22:50:06.213212 2410 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:06.214818 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.207175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36204 (local address 127.12.27.190:42067)
0929 22:50:06.207210 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.207212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.207222 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:50:06.207285 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.207286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.207295 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.207369 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.207902 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.208339 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.209027 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.209218 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.209305 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.212019 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.212021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.212021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.212029 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.213817 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.214187 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.214187 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.214188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.214238 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.214422 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.214422 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.214423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.214511 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.214633 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.214700 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.214758 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:50:06.221007 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.213488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36636)
0929 22:50:06.213586 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.213597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.213649 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.213757 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.213758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.213904 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.213937 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.213939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.214869 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.214870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.215617 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.215619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.216212 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.216213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.216276 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.216625 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.216630 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.218177 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.220042 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.220042 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.220043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.220198 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.220424 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.220425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.220425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.220482 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.220788 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.220788 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.220823 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.220877 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.220944 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260929 22:50:06.221105 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.213542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36636 (local address 127.12.27.188:44085)
0929 22:50:06.213586 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.213588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.213633 (+ 45us) server_negotiation.cc:407] Connection header received
0929 22:50:06.213705 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.213705 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.213713 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.213752 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.214013 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.214789 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.215757 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.216114 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.216193 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.218306 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.218308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.218308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.218314 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.219960 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.220299 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.220300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.220300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.220356 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.220610 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.220611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.220611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.220726 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.220783 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.220932 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.221012 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:50:06.222702 2410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: Bootstrap starting.
I20260929 22:50:06.223786 2410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:06.224128 2410 log.cc:824] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:06.224176 2339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.215530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.12.27.189:40749)
0929 22:50:06.215563 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.215565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.215573 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:50:06.215691 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.215692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.215703 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.215761 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.216361 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.217094 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.218115 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.218396 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.218447 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.221255 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.221257 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.221257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.221264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.222936 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.223374 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.223374 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.223375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.223423 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.223612 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.223612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.223612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.223767 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.223918 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.223997 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.224087 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 22:50:06.224994 2410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: No bootstrap required, opened a new log
I20260929 22:50:06.225615 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:50:06.226625 2410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.226786 2410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313476a0e6954d46b9200eff9375588b, State: Initialized, Role: FOLLOWER
I20260929 22:50:06.226866 2410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.227197 2410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:06.227171 2416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.227267 2416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:06.226516 2234 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "fc1b73d3b0434ac2bf7aca129f75e804"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36204
I20260929 22:50:06.228063 2260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } attempt: 2
W20260929 22:50:06.229671 2427 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:06.229722 2427 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:50:06.229595 2342 master_runner.cc:186] Error getting master registration for 127.12.27.190:42067: OK, instance_id { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" instance_seqno: 1790722205884415 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:50:06.232686 2342 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722205, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:50:06.235831 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.228326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:36638)
0929 22:50:06.228373 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.228385 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.228432 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.228579 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.228580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.228762 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.228829 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.228832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.229715 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.229716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.230476 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.230479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.231059 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.231060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.231113 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.231598 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.231605 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.233126 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.234754 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.234755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.234755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.234931 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.235146 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.235146 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.235147 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.235206 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.235486 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.235487 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.235531 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.235621 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.235740 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260929 22:50:06.235829 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.228366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.12.27.188:44085)
0929 22:50:06.228414 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.228416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.228426 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:50:06.228497 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.228498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.228506 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.228564 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.228918 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.229631 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.230586 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.230949 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.231006 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.233214 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.233216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.233216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.233222 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.234649 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.235014 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.235016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.235016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.235078 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.235278 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.235279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.235280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.235408 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.235481 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.235667 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.235741 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 22:50:06.237236 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804: Bootstrap starting.
I20260929 22:50:06.237850 2260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:06.238207 2260 log.cc:824] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:06.239048 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804: No bootstrap required, opened a new log
I20260929 22:50:06.240130 2260 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.240266 2260 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1b73d3b0434ac2bf7aca129f75e804, State: Initialized, Role: FOLLOWER
I20260929 22:50:06.240355 2260 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.240692 2260 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:06.240651 2430 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.240744 2234 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 22:50:06.240753 2430 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:06.240803 2234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:06.241696 2234 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.241958 2234 leader_election.cc:288] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [CANDIDATE]: Term 1 election: Requested vote from peers a08cbb1c75ff4c11a0ecd85099de4735 (127.12.27.189:40749), 313476a0e6954d46b9200eff9375588b (127.12.27.188:44085)
W20260929 22:50:06.242818 2441 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:06.242863 2441 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:50:06.243291 2384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "313476a0e6954d46b9200eff9375588b"
I20260929 22:50:06.243417 2384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:06.244400 2384 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc1b73d3b0434ac2bf7aca129f75e804 in term 1.
I20260929 22:50:06.243858 2192 master_runner.cc:186] Error getting master registration for 127.12.27.189:40749: OK, instance_id { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" instance_seqno: 1790722206036010 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:50:06.246160 2192 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:50:06.246831 2211 leader_election.cc:302] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313476a0e6954d46b9200eff9375588b, fc1b73d3b0434ac2bf7aca129f75e804; no voters:
I20260929 22:50:06.246948 2430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:50:06.247087 2430 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [term 1 LEADER]: Becoming Leader. State: Replica: fc1b73d3b0434ac2bf7aca129f75e804, State: Running, Role: LEADER
I20260929 22:50:06.247186 2430 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.247592 2450 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc1b73d3b0434ac2bf7aca129f75e804. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.247799 2450 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:06.248322 2452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:50:06.248499 2452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:50:06.249991 2384 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [term 1 FOLLOWER]: Refusing update from remote peer fc1b73d3b0434ac2bf7aca129f75e804: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:50:06.250506 2450 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:50:06.251825 2416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc1b73d3b0434ac2bf7aca129f75e804. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.251952 2416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:06.253033 2430 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.253125 2430 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:06.253238 2416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.253314 2416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:06.254302 2453 mvcc.cc:205] Tried to move back new op lower bound from 7334798156797648896 to 7334798156789182464. Current Snapshot: MvccSnapshot[applied={T|T < 7334798156797648896}]
I20260929 22:50:06.254446 2454 mvcc.cc:205] Tried to move back new op lower bound from 7334798156797648896 to 7334798156789182464. Current Snapshot: MvccSnapshot[applied={T|T < 7334798156797648896}]
I20260929 22:50:06.254786 2452 catalog_manager.cc:1347] Generated new cluster ID: e1aea699cceb48adac8515ac376007d6
I20260929 22:50:06.254829 2452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:50:06.261624 2452 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:50:06.262667 2452 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:50:06.263756 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.244338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36642 (local address 127.12.27.188:44085)
0929 22:50:06.244378 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.244380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.255759 (+ 11379us) server_negotiation.cc:407] Connection header received
0929 22:50:06.255846 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.255847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.255857 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.255886 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.256595 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.257272 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.258246 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.258549 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.258621 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.260139 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.260140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.260140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.260147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.262039 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.262448 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.262449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.262450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.262526 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.262950 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.262951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.262951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.263097 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.263168 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.263531 (+ 363us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.263617 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 22:50:06.268743 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.246234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36206 (local address 127.12.27.190:42067)
0929 22:50:06.246276 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.246280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.251808 (+ 5528us) server_negotiation.cc:407] Connection header received
0929 22:50:06.251942 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.251943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.251954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.251987 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.253393 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.254137 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.255797 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.256099 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.256158 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.265407 (+ 9249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.265408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.265408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.265416 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.267502 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.267896 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.267898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.267898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.267952 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.268151 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.268151 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.268152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.268273 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.268357 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.268565 (+ 208us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.268656 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:50:06.269820 2339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.246660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.12.27.189:40749)
0929 22:50:06.246700 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.246702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.252932 (+ 6230us) server_negotiation.cc:407] Connection header received
0929 22:50:06.253044 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.253046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.253057 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.253091 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.253873 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.254685 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.257189 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.257482 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.257524 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.265372 (+ 7848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.265373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.265374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.265382 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.268353 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.268963 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.268964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.268965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.269020 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.269291 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.269292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.269293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.269441 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.269522 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.269646 (+ 124us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.269731 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 22:50:06.270784 2335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } attempt: 3
Sep 29 22:50:06 dist-test-slave-00d6 krb5kdc[2179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:50:06.279300 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.271018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:44085 (local address 127.0.0.1:37174)
0929 22:50:06.271098 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:06.271107 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:06.271142 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:06.271410 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:06.271410 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:06.271573 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:06.271618 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.271619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.272569 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.272570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.273389 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:06.273392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.273877 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.273878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:06.273933 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.274409 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:06.274414 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:06.276323 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:06.278171 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.278172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.278172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.278368 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.278629 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:06.278630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:06.278630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:06.278682 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:06.279023 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:06.279024 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:06.279085 (+ 61us) client_negotiation.cc:769] Sending connection context
0929 22:50:06.279127 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 22:50:06.279207 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260929 22:50:06.280073 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:06.271209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37174 (local address 127.12.27.188:44085)
0929 22:50:06.271294 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.271296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.271304 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:50:06.271335 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.271336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.271345 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.271392 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.271727 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.272458 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.273494 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:06.273794 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:06.274082 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:06.276412 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:06.276413 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:06.276414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:06.276420 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:06.278073 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.278447 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.278448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.278448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.278523 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:06.278752 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:06.278753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:06.278753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:06.278946 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:06.279743 (+ 797us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:06.279809 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 22:50:06.279904 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:50:06.281886 2335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: Bootstrap starting.
I20260929 22:50:06.282603 2452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804: Generated new TSK 0
I20260929 22:50:06.282716 2335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:06.282775 2452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:50:06.283027 2335 log.cc:824] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:06.284318 2335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: No bootstrap required, opened a new log
I20260929 22:50:06.286811 2335 raft_consensus.cc:348] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.286969 2335 raft_consensus.cc:729] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08cbb1c75ff4c11a0ecd85099de4735, State: Initialized, Role: FOLLOWER
I20260929 22:50:06.287057 2335 consensus_queue.cc:260] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } }
I20260929 22:50:06.287403 2335 sys_catalog.cc:564] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:06.288566 2308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:06.289520 2308 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [term 1 FOLLOWER]: Refusing update from remote peer fc1b73d3b0434ac2bf7aca129f75e804: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:50:06.289891 2430 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:50:06.290288 2309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a08cbb1c75ff4c11a0ecd85099de4735"
I20260929 22:50:06.291088 2309 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc1b73d3b0434ac2bf7aca129f75e804 in term 1.
I20260929 22:50:06.293459 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.293571 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:06.293625 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc1b73d3b0434ac2bf7aca129f75e804. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.293680 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:06.293717 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.293766 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:50:06.294385 2471 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:06.294436 2471 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260929 22:50:06.311985 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.310374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.12.27.189:40749)
0929 22:50:06.310421 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.310423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.311257 (+ 834us) server_negotiation.cc:407] Connection header received
0929 22:50:06.311365 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.311366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.311377 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.311407 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.311890 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48690: BlockingRecv error: recv got EOF from 127.0.0.1:48690 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 22:50:06.312754 2414 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.310746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37184 (local address 127.12.27.188:44085)
0929 22:50:06.310787 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.310788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.312250 (+ 1462us) server_negotiation.cc:407] Connection header received
0929 22:50:06.312348 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.312349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.312359 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.312388 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.312692 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37184: BlockingRecv error: recv got EOF from 127.0.0.1:37184 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 22:50:06.313474 2263 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.311116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36608 (local address 127.12.27.190:42067)
0929 22:50:06.311161 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.311164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.312965 (+ 1801us) server_negotiation.cc:407] Connection header received
0929 22:50:06.313067 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.313068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.313080 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.313109 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.313410 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36608: BlockingRecv error: recv got EOF from 127.0.0.1:36608 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260929 22:50:06.316059 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.315181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48698 (local address 127.12.27.189:40749)
0929 22:50:06.315218 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.315220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.315466 (+ 246us) server_negotiation.cc:407] Connection header received
0929 22:50:06.315576 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.315577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.315598 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.315670 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.315989 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48698: BlockingRecv error: recv got EOF from 127.0.0.1:48698 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 22:50:06.319203 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.318327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48710 (local address 127.12.27.189:40749)
0929 22:50:06.318365 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.318367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.318613 (+ 246us) server_negotiation.cc:407] Connection header received
0929 22:50:06.318709 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.318710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.318721 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.318751 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.319141 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48710: BlockingRecv error: recv got EOF from 127.0.0.1:48710 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 22:50:06.323117 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.322317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48720 (local address 127.12.27.189:40749)
0929 22:50:06.322362 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.322364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.322612 (+ 248us) server_negotiation.cc:407] Connection header received
0929 22:50:06.322707 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.322708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.322718 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.322747 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.323067 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48720: BlockingRecv error: recv got EOF from 127.0.0.1:48720 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260929 22:50:06.329126 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.328281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48728 (local address 127.12.27.189:40749)
0929 22:50:06.328319 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.328321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.328599 (+ 278us) server_negotiation.cc:407] Connection header received
0929 22:50:06.328697 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.328698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.328710 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.328741 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.329077 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48728: BlockingRecv error: recv got EOF from 127.0.0.1:48728 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 22:50:06.339241 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.338315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48736 (local address 127.12.27.189:40749)
0929 22:50:06.338357 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.338359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.338634 (+ 275us) server_negotiation.cc:407] Connection header received
0929 22:50:06.338741 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.338742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.338753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.338784 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.339172 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48736: BlockingRecv error: recv got EOF from 127.0.0.1:48736 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:50:06.357688 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.356659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48740 (local address 127.12.27.189:40749)
0929 22:50:06.356708 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.356710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.357038 (+ 328us) server_negotiation.cc:407] Connection header received
0929 22:50:06.357154 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.357155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.357168 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.357200 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.357626 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48740: BlockingRecv error: recv got EOF from 127.0.0.1:48740 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 22:50:06.392088 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.391000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48748 (local address 127.12.27.189:40749)
0929 22:50:06.391060 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.391062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.391400 (+ 338us) server_negotiation.cc:407] Connection header received
0929 22:50:06.391510 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.391512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.391524 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.391556 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.392012 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48748: BlockingRecv error: recv got EOF from 127.0.0.1:48748 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260929 22:50:06.458205 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.457395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48750 (local address 127.12.27.189:40749)
0929 22:50:06.457462 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.457465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.457582 (+ 117us) server_negotiation.cc:407] Connection header received
0929 22:50:06.457665 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.457665 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.457676 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.457729 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.458117 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48750: BlockingRecv error: recv got EOF from 127.0.0.1:48750 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260929 22:50:06.588518 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.587550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.12.27.189:40749)
0929 22:50:06.587612 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.587615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.587823 (+ 208us) server_negotiation.cc:407] Connection header received
0929 22:50:06.587931 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.587933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.587947 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.587976 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.588450 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48754: BlockingRecv error: recv got EOF from 127.0.0.1:48754 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260929 22:50:06.846511 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:06.845753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48768 (local address 127.12.27.189:40749)
0929 22:50:06.845824 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:06.845825 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:06.845868 (+ 43us) server_negotiation.cc:407] Connection header received
0929 22:50:06.845960 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:06.845961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:06.845971 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:06.846063 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:06.846427 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48768: BlockingRecv error: recv got EOF from 127.0.0.1:48768 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:50:06.888130 2430 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1b73d3b0434ac2bf7aca129f75e804" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 42067 } } peers { permanent_uuid: "a08cbb1c75ff4c11a0ecd85099de4735" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 40749 } } peers { permanent_uuid: "313476a0e6954d46b9200eff9375588b" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 44085 } } }
I20260929 22:50:06.888284 2430 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1b73d3b0434ac2bf7aca129f75e804 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:07.230178 2427 catalog_manager.cc:1259] Loaded cluster ID: e1aea699cceb48adac8515ac376007d6
I20260929 22:50:07.230293 2427 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: loading cluster ID for follower catalog manager: success
I20260929 22:50:07.231108 2427 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: acquiring CA information for follower catalog manager: success
I20260929 22:50:07.231418 2427 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 313476a0e6954d46b9200eff9375588b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:50:07.294904 2471 catalog_manager.cc:1259] Loaded cluster ID: e1aea699cceb48adac8515ac376007d6
I20260929 22:50:07.295003 2471 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: loading cluster ID for follower catalog manager: success
I20260929 22:50:07.295972 2471 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: acquiring CA information for follower catalog manager: success
I20260929 22:50:07.296315 2471 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a08cbb1c75ff4c11a0ecd85099de4735: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:50:07.362763 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:07.359838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48774 (local address 127.12.27.189:40749)
0929 22:50:07.359983 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:07.359985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:07.360015 (+ 30us) server_negotiation.cc:407] Connection header received
0929 22:50:07.360090 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:07.360091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:07.360141 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:07.360216 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:07.360481 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.360999 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.361760 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.362027 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.362094 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:07.362351 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:07.362464 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:07.362538 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:07.362593 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 22:50:07.362613 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260929 22:50:07.366959 2552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:07.364667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37188 (local address 127.12.27.188:44085)
0929 22:50:07.364786 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:07.364788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:07.364803 (+ 15us) server_negotiation.cc:407] Connection header received
0929 22:50:07.364836 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:07.364836 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:07.364869 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:07.364937 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:07.365021 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.365502 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.366201 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.366382 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.366430 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:07.366551 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:07.366653 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:07.366712 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:07.366819 (+ 107us) server_negotiation.cc:299] Negotiation successful
0929 22:50:07.366835 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":75,"threads_started":1}
I20260929 22:50:07.371800 2559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:07.368699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.12.27.190:42067)
0929 22:50:07.368853 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:07.368855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:07.368864 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:50:07.368905 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:07.368906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:07.368979 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:07.369074 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:07.369174 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.369797 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.370864 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.371158 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.371222 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:07.371420 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:07.371541 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:07.371606 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:07.371695 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 22:50:07.371719 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":53,"threads_started":1}
I20260929 22:50:07.371797 2552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:07.368936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37204 (local address 127.12.27.188:44085)
0929 22:50:07.368972 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:07.368974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:07.369259 (+ 285us) server_negotiation.cc:407] Connection header received
0929 22:50:07.369310 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:07.369311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:07.369320 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:07.369369 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:07.369508 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.370171 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.370939 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.371167 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.371245 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:07.371522 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:07.371552 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:07.371581 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:07.371716 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 22:50:07.371735 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:50:07.372007 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:07.368774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.12.27.189:40749)
0929 22:50:07.368816 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:07.368818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:07.368971 (+ 153us) server_negotiation.cc:407] Connection header received
0929 22:50:07.369000 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:07.369001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:07.369014 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:07.369067 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:07.369227 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.369960 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.370989 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:07.371278 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:07.371362 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:07.371517 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:07.371546 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:07.371599 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:07.371875 (+ 276us) server_negotiation.cc:299] Negotiation successful
0929 22:50:07.371900 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:50:07.373844 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2192
I20260929 22:50:07.379194 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2267
I20260929 22:50:07.383791 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2342
2026-09-29T22:50:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2780 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 22:50:07 dist-test-slave-00d6 krb5kdc[2563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 22:50:07 dist-test-slave-00d6 krb5kdc[2563](info): set up 2 sockets
Sep 29 22:50:07 dist-test-slave-00d6 krb5kdc[2563](info): commencing operation
krb5kdc: starting...
W20260929 22:50:08.488610 12398 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/test-user.keytab.
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T22:50:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T22:50:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.27.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
Entry for principal kudu/127.12.27.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab.
I20260929 22:50:08.611783 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:33177
--webserver_interface=127.12.27.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:33177,127.12.27.189:45217,127.12.27.188:33031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 22:50:08.695254 2576 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:50:08.695470 2576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:08.695487 2576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:08.695508 2576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:08.696795 2576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:08.696839 2576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:08.696853 2576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:08.696866 2576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:08.696879 2576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:08.698376 2576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:33177,127.12.27.189:45217,127.12.27.188:33031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.190.keytab
--principal=kudu/127.12.27.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.190:33177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.27.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:08.698635 2576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:08.698868 2576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:08.703779 2581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:08.703811 2584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:08.703826 2582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:08.704133 2576 server_base.cc:1034] running on GCE node
I20260929 22:50:08.704396 2576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:08.704701 2576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:08.705865 2576 hybrid_clock.cc:648] HybridClock initialized: now 1790722208705864 us; error 40 us; skew 500 ppm
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:08.708499 2576 init.cc:377] Logged in from keytab as kudu/127.12.27.190@KRBTEST.COM (short username kudu)
I20260929 22:50:08.708977 2576 webserver.cc:460] Webserver started at http://127.12.27.190:42863/ using document root <none> and password file <none>
I20260929 22:50:08.709201 2576 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:08.709267 2576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:08.709419 2576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:08.710448 2576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data/instance:
uuid: "d29ee83b017f430c87c14b00e8c8f624"
format_stamp: "Formatted at 2026-09-29 22:50:08 on dist-test-slave-00d6"
server_key: "11e627451ba9cf830bb2ba99dfc416a5"
server_key_iv: "06c7e2e4015f68398b02677495fb3203"
server_key_version: "encryptionkey@0"
I20260929 22:50:08.710821 2576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal/instance:
uuid: "d29ee83b017f430c87c14b00e8c8f624"
format_stamp: "Formatted at 2026-09-29 22:50:08 on dist-test-slave-00d6"
server_key: "11e627451ba9cf830bb2ba99dfc416a5"
server_key_iv: "06c7e2e4015f68398b02677495fb3203"
server_key_version: "encryptionkey@0"
I20260929 22:50:08.712251 2576 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 22:50:08.712999 2591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:08.713186 2576 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:08.713289 2576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal
uuid: "d29ee83b017f430c87c14b00e8c8f624"
format_stamp: "Formatted at 2026-09-29 22:50:08 on dist-test-slave-00d6"
server_key: "11e627451ba9cf830bb2ba99dfc416a5"
server_key_iv: "06c7e2e4015f68398b02677495fb3203"
server_key_version: "encryptionkey@0"
I20260929 22:50:08.713366 2576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:08.732813 2576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:08.735236 2576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:08.735411 2576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:08.739689 2576 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.190:33177
I20260929 22:50:08.739734 2643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.190:33177 every 8 connection(s)
I20260929 22:50:08.740118 2576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/data/info.pb
I20260929 22:50:08.741168 2644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:08.742832 2644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:08.746970 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2576
I20260929 22:50:08.747056 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-0/wal/instance
I20260929 22:50:08.747270 12398 external_mini_cluster.cc:1428] Setting key 3bcc0d6f3183e5a9219890b3f5ee3c8f
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:08.753541 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.743584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:33177 (local address 127.0.0.1:42556)
0929 22:50:08.743777 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.743839 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:08.744346 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:08.744687 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:08.744689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:08.745000 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:08.745163 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.745168 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.746277 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.746278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.747041 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.747044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.747676 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.747677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.747746 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.748352 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:08.748361 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:08.749835 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:08.751875 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.751881 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.751884 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.752119 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.752400 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.752401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.752402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.752501 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.752893 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:08.752898 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:08.752965 (+ 67us) client_negotiation.cc:769] Sending connection context
0929 22:50:08.753083 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 22:50:08.753343 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":99,"thread_start_us":98,"threads_started":1}
I20260929 22:50:08.753547 2647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.743765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42556 (local address 127.12.27.190:33177)
0929 22:50:08.743879 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:08.743886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:08.743927 (+ 41us) server_negotiation.cc:407] Connection header received
0929 22:50:08.744543 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:08.744544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:08.744563 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:08.744680 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:08.745277 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.746156 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.747145 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.747526 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.747684 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.749947 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:08.749954 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:08.749955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:08.749969 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:08.751772 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.752225 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.752228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.752228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.752326 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.752573 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.752574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.752574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.752806 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:08.752903 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:08.753116 (+ 213us) server_negotiation.cc:299] Negotiation successful
0929 22:50:08.753270 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":41,"threads_started":1}
WARNING: no policy specified for kudu/127.12.27.189@KRBTEST.COM; defaulting to no policy
I20260929 22:50:08.754354 2644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:08.754729 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.754611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52290)
0929 22:50:08.754662 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.754706 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 22:50:08.754906 2594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
I20260929 22:50:08.755421 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.755281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52306)
0929 22:50:08.755357 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.755388 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260929 22:50:08.755564 2644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:45217: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab.
Entry for principal kudu/127.12.27.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab.
I20260929 22:50:08.772454 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:45217
--webserver_interface=127.12.27.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab
--principal=kudu/127.12.27.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:33177,127.12.27.189:45217,127.12.27.188:33031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:50:08.804824 2644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } attempt: 1
I20260929 22:50:08.805346 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.805200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52318)
0929 22:50:08.805275 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.805315 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 22:50:08.805712 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.805617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52322)
0929 22:50:08.805663 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.805690 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 22:50:08.805799 2644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:45217: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
W20260929 22:50:08.856612 2651 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:50:08.856851 2651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:08.856880 2651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:08.856942 2651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:08.858052 2651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:08.858139 2651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:08.858165 2651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:08.858192 2651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:08.858222 2651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:08.859786 2651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:33177,127.12.27.189:45217,127.12.27.188:33031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.189.keytab
--principal=kudu/127.12.27.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.189:45217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.27.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:08.860054 2651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:08.860289 2651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:08.865514 2656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:08.865541 2659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:08.865597 2651 server_base.cc:1034] running on GCE node
W20260929 22:50:08.865531 2657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:08.865967 2651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:08.866232 2651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:08.867372 2651 hybrid_clock.cc:648] HybridClock initialized: now 1790722208867355 us; error 39 us; skew 500 ppm
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:08.869920 2651 init.cc:377] Logged in from keytab as kudu/127.12.27.189@KRBTEST.COM (short username kudu)
I20260929 22:50:08.870380 2651 webserver.cc:460] Webserver started at http://127.12.27.189:46627/ using document root <none> and password file <none>
I20260929 22:50:08.870628 2651 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:08.870704 2651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:08.870849 2651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:08.871997 2651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data/instance:
uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6"
format_stamp: "Formatted at 2026-09-29 22:50:08 on dist-test-slave-00d6"
server_key: "21b79a57897ad943345962a3c02b737b"
server_key_iv: "ff4f6acb0287bf0c32a7d18e07d7204f"
server_key_version: "encryptionkey@0"
I20260929 22:50:08.872361 2651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal/instance:
uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6"
format_stamp: "Formatted at 2026-09-29 22:50:08 on dist-test-slave-00d6"
server_key: "21b79a57897ad943345962a3c02b737b"
server_key_iv: "ff4f6acb0287bf0c32a7d18e07d7204f"
server_key_version: "encryptionkey@0"
I20260929 22:50:08.873694 2651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:50:08.873934 2644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } attempt: 2
I20260929 22:50:08.874342 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.874205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52326)
0929 22:50:08.874269 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.874304 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 22:50:08.874565 2666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:08.874763 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.874663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52338)
0929 22:50:08.874707 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.874739 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 22:50:08.874750 2651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:50:08.874846 2651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal
uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6"
format_stamp: "Formatted at 2026-09-29 22:50:08 on dist-test-slave-00d6"
server_key: "21b79a57897ad943345962a3c02b737b"
server_key_iv: "ff4f6acb0287bf0c32a7d18e07d7204f"
server_key_version: "encryptionkey@0"
W20260929 22:50:08.874873 2644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.189:45217: Network error: Client connection negotiation failed: client connection to 127.12.27.189:45217: connect: Connection refused (error 111)
I20260929 22:50:08.874972 2651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:08.904765 2651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:08.907294 2651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:08.907454 2651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:08.911375 2651 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.189:45217
I20260929 22:50:08.911465 2719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.189:45217 every 8 connection(s)
I20260929 22:50:08.911806 2651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/data/info.pb
I20260929 22:50:08.912796 2720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:08.914361 2720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:08.917520 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2651
I20260929 22:50:08.917636 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-1/wal/instance
I20260929 22:50:08.917843 12398 external_mini_cluster.cc:1428] Setting key 0b9db07da350f3691e734889ea015951
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:08.925166 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.915032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:33177 (local address 127.0.0.1:42562)
0929 22:50:08.915226 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.915265 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:08.915789 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:08.916080 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:08.916083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:08.916373 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:08.916570 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.916574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.917364 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.917366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.918672 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.918675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.919100 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.919101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.919261 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.919852 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:08.919861 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:08.921553 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:08.923590 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.923597 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.923599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.923890 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.924160 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.924161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.924161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.924295 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.924631 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:08.924637 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:08.924783 (+ 146us) client_negotiation.cc:769] Sending connection context
0929 22:50:08.924871 (+ 88us) client_negotiation.cc:240] Negotiation successful
0929 22:50:08.925002 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260929 22:50:08.925161 2647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.915058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42562 (local address 127.12.27.190:33177)
0929 22:50:08.915134 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:08.915137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:08.915357 (+ 220us) server_negotiation.cc:407] Connection header received
0929 22:50:08.915895 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:08.915896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:08.915912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:08.915982 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:08.916653 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.917252 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.918760 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.918961 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.919021 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.921658 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:08.921659 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:08.921660 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:08.921669 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:08.923498 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.923971 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.923972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.923973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.924047 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.924387 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.924389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.924389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.924545 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:08.924619 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:08.924943 (+ 324us) server_negotiation.cc:299] Negotiation successful
0929 22:50:08.925035 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:50:08.925869 2720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.27.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.27.188@KRBTEST.COM" created.
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:50:08.934289 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.926183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52346)
0929 22:50:08.926231 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.926243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:08.926283 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:08.926538 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:08.926538 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:08.926650 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:08.926702 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.926703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.927612 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.927613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.928190 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.928192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.928747 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.928749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.928824 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.929298 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:08.929308 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:08.930772 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:08.933112 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.933113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.933113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.933430 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.933678 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.933679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.933679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.933731 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.934063 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:08.934063 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:08.934099 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 22:50:08.934151 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 22:50:08.934222 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 22:50:08.934579 2724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.926255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52346 (local address 127.12.27.189:45217)
0929 22:50:08.926400 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:08.926404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:08.926420 (+ 16us) server_negotiation.cc:407] Connection header received
0929 22:50:08.926439 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:08.926440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:08.926452 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:08.926526 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:08.926773 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.927532 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.928275 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.928657 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.928729 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.930870 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:08.930878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:08.930879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:08.930887 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:08.933021 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.933529 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.933533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.933534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.933605 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.933797 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.933798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.933798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.933991 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:08.934084 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:08.934192 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 22:50:08.934293 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260929 22:50:08.935300 2720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:08.935725 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.935563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58398)
0929 22:50:08.935617 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.935693 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:50:08.935894 2670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
I20260929 22:50:08.936357 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.936242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58404)
0929 22:50:08.936294 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.936328 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:50:08.936518 2720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:33031: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.27.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab.
Entry for principal kudu/127.12.27.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab.
I20260929 22:50:08.947466 12398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskh9tbJl/build/release/bin/kudu
/tmp/dist-test-taskh9tbJl/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:33031
--webserver_interface=127.12.27.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab
--principal=kudu/127.12.27.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.27.148:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.27.190:33177,127.12.27.189:45217,127.12.27.188:33031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 22:50:08.966094 2644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } attempt: 3
Sep 29 22:50:08 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:50:08.973611 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.966514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52352)
0929 22:50:08.966583 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.966597 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:08.966682 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:08.966848 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:08.966849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:08.967078 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:08.967154 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.967156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.967918 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.967920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.968504 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:08.968507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.968921 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.968922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:08.969004 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.969503 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:08.969507 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:08.970874 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:08.972519 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.972521 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.972521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.972739 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.972984 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:08.972985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:08.972985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:08.973051 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:08.973291 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:08.973292 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:08.973340 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 22:50:08.973417 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 22:50:08.973512 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 22:50:08.973623 2724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.966603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52352 (local address 127.12.27.189:45217)
0929 22:50:08.966678 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:08.966680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:08.966692 (+ 12us) server_negotiation.cc:407] Connection header received
0929 22:50:08.966749 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:08.966750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:08.966769 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:08.966842 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:08.967253 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.967832 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.968608 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:08.968841 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:08.968923 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:08.970974 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:08.970975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:08.970975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:08.970982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:08.972439 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.972843 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.972844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.972845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.972903 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:08.973117 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:08.973118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:08.973118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:08.973228 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:08.973282 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:08.973485 (+ 203us) server_negotiation.cc:299] Negotiation successful
0929 22:50:08.973559 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 22:50:08.974092 2644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:08.974423 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.974315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58410)
0929 22:50:08.974367 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.974399 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 22:50:08.974753 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.974670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58424)
0929 22:50:08.974715 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.974739 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:50:08.974858 2644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:33031: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
I20260929 22:50:08.985744 2720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } attempt: 1
I20260929 22:50:08.986186 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.986061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58428)
0929 22:50:08.986119 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.986157 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 22:50:08.986548 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:08.986420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58432)
0929 22:50:08.986477 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:08.986519 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260929 22:50:08.986680 2720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:33031: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
I20260929 22:50:09.006026 2644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } attempt: 1
I20260929 22:50:09.006549 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.006401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58434)
0929 22:50:09.006474 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.006517 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260929 22:50:09.006947 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.006856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58448)
0929 22:50:09.006903 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.006931 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 22:50:09.007079 2644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:33031: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
W20260929 22:50:09.031239 2727 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 22:50:09.031453 2727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 22:50:09.031477 2727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 22:50:09.031497 2727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 22:50:09.032680 2727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 22:50:09.032732 2727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 22:50:09.032747 2727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 22:50:09.032759 2727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 22:50:09.032773 2727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 22:50:09.034178 2727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.27.148:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.27.190:33177,127.12.27.189:45217,127.12.27.188:33031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/krb5kdc/kudu_127.12.27.188.keytab
--principal=kudu/127.12.27.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.27.188:33031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.27.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 21:58:54 UTC on ccycloud.quasar-xguoti.root.comops.site
build id 4681390
I20260929 22:50:09.034363 2727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 22:50:09.034536 2727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 22:50:09.039304 2735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:09.039342 2727 server_base.cc:1034] running on GCE node
W20260929 22:50:09.039451 2733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 22:50:09.039326 2732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 22:50:09.039788 2727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 22:50:09.040072 2727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 22:50:09.041244 2727 hybrid_clock.cc:648] HybridClock initialized: now 1790722209041224 us; error 38 us; skew 500 ppm
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722209, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 22:50:09.043883 2727 init.cc:377] Logged in from keytab as kudu/127.12.27.188@KRBTEST.COM (short username kudu)
I20260929 22:50:09.044272 2727 webserver.cc:460] Webserver started at http://127.12.27.188:37285/ using document root <none> and password file <none>
I20260929 22:50:09.044457 2727 fs_manager.cc:359] Metadata directory not provided
I20260929 22:50:09.044498 2727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 22:50:09.044582 2727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 22:50:09.045589 2727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data/instance:
uuid: "90b08c06b80142e2a4fd377f8de37ad2"
format_stamp: "Formatted at 2026-09-29 22:50:09 on dist-test-slave-00d6"
server_key: "022d1d236c1ec1ae67730e0e02abc181"
server_key_iv: "598b4021a68eb1324ce3c6b3d43b36dc"
server_key_version: "encryptionkey@0"
I20260929 22:50:09.045892 2727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal/instance:
uuid: "90b08c06b80142e2a4fd377f8de37ad2"
format_stamp: "Formatted at 2026-09-29 22:50:09 on dist-test-slave-00d6"
server_key: "022d1d236c1ec1ae67730e0e02abc181"
server_key_iv: "598b4021a68eb1324ce3c6b3d43b36dc"
server_key_version: "encryptionkey@0"
I20260929 22:50:09.047163 2727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 22:50:09.047873 2742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 22:50:09.048062 2727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 22:50:09.048144 2727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data,/tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal
uuid: "90b08c06b80142e2a4fd377f8de37ad2"
format_stamp: "Formatted at 2026-09-29 22:50:09 on dist-test-slave-00d6"
server_key: "022d1d236c1ec1ae67730e0e02abc181"
server_key_iv: "598b4021a68eb1324ce3c6b3d43b36dc"
server_key_version: "encryptionkey@0"
I20260929 22:50:09.048195 2727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 22:50:09.054859 2720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } attempt: 2
I20260929 22:50:09.055346 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.055155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58460)
0929 22:50:09.055276 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.055314 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260929 22:50:09.055744 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.055619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58470)
0929 22:50:09.055698 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.055725 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260929 22:50:09.055848 2720 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.27.188:33031: Network error: Client connection negotiation failed: client connection to 127.12.27.188:33031: connect: Connection refused (error 111)
I20260929 22:50:09.070490 2727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 22:50:09.072971 2727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 22:50:09.073150 2727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 22:50:09.077342 2727 rpc_server.cc:307] RPC server started. Bound to: 127.12.27.188:33031
I20260929 22:50:09.077399 2794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.27.188:33031 every 8 connection(s)
I20260929 22:50:09.077805 2727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/data/info.pb
I20260929 22:50:09.078817 2795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 22:50:09.080457 2795 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:09.082233 2644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } attempt: 2
I20260929 22:50:09.082479 12398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskh9tbJl/build/release/bin/kudu as pid 2727
I20260929 22:50:09.082612 12398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskh9tbJl/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790721915685765-12398-0/minicluster-data/master-2/wal/instance
I20260929 22:50:09.082855 12398 external_mini_cluster.cc:1428] Setting key 280737094634eb844d5924242881ebab
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722209, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.190@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:50:09.091486 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.082471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58486)
0929 22:50:09.082518 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.082528 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:09.082561 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:09.082881 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:09.082883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:09.083086 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:09.083125 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.083127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.084631 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.084632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.085175 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.085177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.085756 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.085757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.085818 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.086331 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:09.086336 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:09.087915 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:09.089837 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.089838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.089839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.090074 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.090432 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.090433 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.090438 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.090544 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.091061 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:09.091062 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:09.091112 (+ 50us) client_negotiation.cc:769] Sending connection context
0929 22:50:09.091258 (+ 146us) client_negotiation.cc:240] Negotiation successful
0929 22:50:09.091360 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 22:50:09.091930 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.082556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58486 (local address 127.12.27.188:33031)
0929 22:50:09.082715 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.082720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.082737 (+ 17us) server_negotiation.cc:407] Connection header received
0929 22:50:09.082757 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.082759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.082776 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.082854 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.083234 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.084554 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.085252 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.085674 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.085757 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.088007 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.088015 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.088015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.088022 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.089713 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.090255 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.090258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.090258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.090351 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.090620 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.090622 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.090622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.090958 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.091035 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.091345 (+ 310us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.091469 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
I20260929 22:50:09.092876 2647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.081150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42578 (local address 127.12.27.190:33177)
0929 22:50:09.081218 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.081220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.081435 (+ 215us) server_negotiation.cc:407] Connection header received
0929 22:50:09.081979 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.081981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.081994 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.082051 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.082939 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.083731 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.084787 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.085070 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.085131 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.088244 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.088248 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.088248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.088254 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.090893 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.091452 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.091453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.091453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.091516 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.092040 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.092041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.092042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.092190 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.092251 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.092671 (+ 420us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.092798 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 22:50:09.093865 2644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624: Bootstrap starting.
I20260929 22:50:09.094470 2644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:09.094700 2644 log.cc:824] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:09.095131 2797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.081122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.190:33177 (local address 127.0.0.1:42578)
0929 22:50:09.081318 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.081354 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:09.081861 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:09.082118 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:09.082122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:09.082542 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:09.082829 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.082834 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.083818 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.083819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.084695 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.084697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.085236 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.085237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.085369 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.086049 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:09.086058 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:09.088152 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:09.090977 (+ 2825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.090984 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.090986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.091375 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.091879 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.091880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.091880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.091964 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.092243 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:09.092249 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:09.092303 (+ 54us) client_negotiation.cc:769] Sending connection context
0929 22:50:09.092631 (+ 328us) client_negotiation.cc:240] Negotiation successful
0929 22:50:09.094951 (+ 2320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260929 22:50:09.095167 2800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.083377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58492 (local address 127.12.27.188:33031)
0929 22:50:09.083493 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.083494 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.083501 (+ 7us) server_negotiation.cc:407] Connection header received
0929 22:50:09.083520 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.083521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.083529 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.083596 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.084358 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.085051 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.085936 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.086231 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.086303 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.089702 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.089703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.089703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.089710 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.091799 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.092206 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.092207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.092208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.092266 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.092485 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.092486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.092486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.092618 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.093176 (+ 558us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.093220 (+ 44us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.095026 (+ 1806us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1731,"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260929 22:50:09.095522 2644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624: No bootstrap required, opened a new log
I20260929 22:50:09.095532 2795 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:09.097675 2644 raft_consensus.cc:348] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.097815 2644 raft_consensus.cc:729] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d29ee83b017f430c87c14b00e8c8f624, State: Initialized, Role: FOLLOWER
I20260929 22:50:09.097903 2644 consensus_queue.cc:260] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.098233 2644 sys_catalog.cc:564] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:09.098284 2802 sys_catalog.cc:455] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.098380 2802 sys_catalog.cc:458] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:50:09.100160 2813 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:09.100211 2813 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722209, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.190@KRBTEST.COM
I20260929 22:50:09.101712 2576 master_runner.cc:186] Error getting master registration for 127.12.27.189:45217: OK, instance_id { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" instance_seqno: 1790722208910344 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:50:09.104285 2576 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:50:09.104583 2797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.095787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.189:45217 (local address 127.0.0.1:52368)
0929 22:50:09.095968 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.095978 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:09.096033 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:09.096205 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:09.096205 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:09.096356 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:09.096418 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.096420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.097295 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.097296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.098145 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.098147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.098683 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.098684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.098768 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.099140 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:09.099145 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:09.101170 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:09.103468 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.103469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.103469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.103724 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.103945 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.103946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.103946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.104014 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.104293 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:09.104294 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:09.104334 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 22:50:09.104395 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 22:50:09.104485 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260929 22:50:09.104856 2724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.095889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.12.27.189:45217)
0929 22:50:09.095931 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.095932 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.096010 (+ 78us) server_negotiation.cc:407] Connection header received
0929 22:50:09.096099 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.096100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.096112 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.096184 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.096506 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.097201 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.098242 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.098555 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.098602 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.101261 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.101263 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.101264 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.101271 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.103366 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.103807 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.103808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.103809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.103866 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.104083 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.104084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.104084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.104208 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.104267 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.104694 (+ 427us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.104765 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:50:09.105307 2795 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } has no permanent_uuid. Determining permanent_uuid...
I20260929 22:50:09.106387 2647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.095787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42588 (local address 127.12.27.190:33177)
0929 22:50:09.095822 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.095824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.095905 (+ 81us) server_negotiation.cc:407] Connection header received
0929 22:50:09.096003 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.096004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.096015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.096048 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.096689 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.097149 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.097827 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.098105 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.098167 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.101310 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.101311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.101312 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.101319 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.104935 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.105309 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.105311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.105311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.105364 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.105571 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.105572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.105572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.105706 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.105828 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.106217 (+ 389us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.106292 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722209, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.188@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.27.189@KRBTEST.COM
I20260929 22:50:09.112911 2797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.105560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58504)
0929 22:50:09.105600 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.105610 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:09.105646 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:09.105759 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:09.105759 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:09.105891 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:09.105927 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.105928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.106798 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.106798 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.107469 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.107471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.107927 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.107937 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.107995 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.108388 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:09.108393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:09.109772 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:09.111855 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.111855 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.111856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.112030 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.112232 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.112232 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.112233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.112278 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.112584 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:09.112585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:09.112622 (+ 37us) client_negotiation.cc:769] Sending connection context
0929 22:50:09.112706 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 22:50:09.112801 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260929 22:50:09.113176 2800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.105588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58504 (local address 127.12.27.188:33031)
0929 22:50:09.105622 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.105624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.105634 (+ 10us) server_negotiation.cc:407] Connection header received
0929 22:50:09.105691 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.105692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.105701 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.105756 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.106023 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.106724 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.107565 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.107864 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.107937 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.109876 (+ 1939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.109877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.109877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.109884 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.111765 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.112115 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.112116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.112117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.112165 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.112356 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.112357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.112358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.112509 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.112582 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.112728 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.112851 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":18}
I20260929 22:50:09.114353 2795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: Bootstrap starting.
I20260929 22:50:09.115015 2795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:09.115312 2795 log.cc:824] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:09.115942 2724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.107093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52378 (local address 127.12.27.189:45217)
0929 22:50:09.107155 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.107157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.107165 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:50:09.107184 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.107185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.107193 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.107257 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.107865 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.108514 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.109428 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.109742 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.109826 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.112660 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.112661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.112661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.112668 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.114398 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.114767 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.114768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.114769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.114821 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.115023 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.115023 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.115024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.115143 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.115284 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.115726 (+ 442us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.115802 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 22:50:09.116253 2795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: No bootstrap required, opened a new log
I20260929 22:50:09.117514 12398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 22:50:09.118139 2795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.118312 2795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b08c06b80142e2a4fd377f8de37ad2, State: Initialized, Role: FOLLOWER
I20260929 22:50:09.118393 2795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.118436 2618 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d29ee83b017f430c87c14b00e8c8f624"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42588
I20260929 22:50:09.118590 2618 raft_consensus.cc:482] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 22:50:09.118643 2618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:09.118706 2795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:09.119740 2618 raft_consensus.cc:504] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.119748 2816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.119920 2816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:09.120051 2618 leader_election.cc:288] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [CANDIDATE]: Term 1 election: Requested vote from peers bfd2dfda8b5247ad97ab9340b6b00fc6 (127.12.27.189:45217), 90b08c06b80142e2a4fd377f8de37ad2 (127.12.27.188:33031)
W20260929 22:50:09.120664 2827 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:09.121912 2827 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:50:09.120723 2769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d29ee83b017f430c87c14b00e8c8f624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "90b08c06b80142e2a4fd377f8de37ad2"
I20260929 22:50:09.122010 2769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:09.122885 2769 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d29ee83b017f430c87c14b00e8c8f624 in term 1.
I20260929 22:50:09.123250 2595 leader_election.cc:302] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90b08c06b80142e2a4fd377f8de37ad2, d29ee83b017f430c87c14b00e8c8f624; no voters:
I20260929 22:50:09.123409 2802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 22:50:09.123575 2802 raft_consensus.cc:686] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [term 1 LEADER]: Becoming Leader. State: Replica: d29ee83b017f430c87c14b00e8c8f624, State: Running, Role: LEADER
I20260929 22:50:09.123733 2727 master_runner.cc:186] Error getting master registration for 127.12.27.189:45217: OK, instance_id { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" instance_seqno: 1790722208910344 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 22:50:09.125914 2727 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 22:50:09.126036 2802 consensus_queue.cc:237] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.126688 2833 sys_catalog.cc:455] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d29ee83b017f430c87c14b00e8c8f624. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.126788 2833 sys_catalog.cc:458] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:09.127084 2835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 22:50:09.127477 2835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 22:50:09.128952 2769 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [term 1 FOLLOWER]: Refusing update from remote peer d29ee83b017f430c87c14b00e8c8f624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:50:09.129256 2833 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:50:09.130499 2816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d29ee83b017f430c87c14b00e8c8f624. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.130580 2816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:09.131583 2802 sys_catalog.cc:455] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.131676 2802 sys_catalog.cc:458] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:09.131932 2835 catalog_manager.cc:1347] Generated new cluster ID: da587affd01a4a69a36c9cb01e1dd15d
I20260929 22:50:09.131974 2835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 22:50:09.132222 2816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.132282 2816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:09.139683 2838 mvcc.cc:205] Tried to move back new op lower bound from 7334798168590168064 to 7334798168581152768. Current Snapshot: MvccSnapshot[applied={T|T < 7334798168590168064 or (T in {7334798168590168064})}]
I20260929 22:50:09.141499 2647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.127876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42592 (local address 127.12.27.190:33177)
0929 22:50:09.127915 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.127917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.132471 (+ 4554us) server_negotiation.cc:407] Connection header received
0929 22:50:09.132579 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.132579 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.132590 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.132620 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.133384 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.134101 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.135772 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.136116 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.136152 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.138417 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.138418 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.138418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.138438 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.139990 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.140607 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.140608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.140608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.140671 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.140860 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.140860 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.140861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.140983 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.141063 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.141345 (+ 282us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.141413 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 22:50:09.145663 2835 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 22:50:09.146864 2835 catalog_manager.cc:1504] Loading token signing keys...
I20260929 22:50:09.146963 2720 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } attempt: 3
Sep 29 22:50:09 dist-test-slave-00d6 krb5kdc[2563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790722208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.27.189@KRBTEST.COM for kudu/127.12.27.188@KRBTEST.COM
I20260929 22:50:09.157353 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.147227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.27.188:33031 (local address 127.0.0.1:58518)
0929 22:50:09.147305 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 22:50:09.147316 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 22:50:09.147351 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 22:50:09.147593 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 22:50:09.147594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 22:50:09.147795 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0929 22:50:09.147845 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.147846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.148812 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.148814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.149672 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 22:50:09.149674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.150291 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.150292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 22:50:09.150371 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.150779 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 22:50:09.150784 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 22:50:09.154566 (+ 3782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 22:50:09.156341 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.156342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.156343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.156539 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.156728 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 22:50:09.156728 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 22:50:09.156729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 22:50:09.156782 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 22:50:09.157053 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 22:50:09.157054 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 22:50:09.157098 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 22:50:09.157158 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 22:50:09.157249 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260929 22:50:09.157896 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.147419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58518 (local address 127.12.27.188:33031)
0929 22:50:09.147452 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.147454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.147472 (+ 18us) server_negotiation.cc:407] Connection header received
0929 22:50:09.147489 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.147489 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.147498 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.147540 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.147964 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.148704 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.149780 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.150156 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.150222 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.154658 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.154659 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.154659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.154666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.156243 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.156614 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.156615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.156615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.156666 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.156840 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.156840 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.156841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.156976 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.157030 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.157723 (+ 693us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.157804 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:50:09.159593 2720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: Bootstrap starting.
I20260929 22:50:09.160154 2800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.132079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58512 (local address 127.12.27.188:33031)
0929 22:50:09.132112 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.132114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.139899 (+ 7785us) server_negotiation.cc:407] Connection header received
0929 22:50:09.140322 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.140323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.140332 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.140361 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.145548 (+ 5187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.146269 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.148109 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.148383 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.148420 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.150781 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.150782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.150783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.150789 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.152999 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.158572 (+ 5573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.158573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.158573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.158626 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.159087 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.159088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.159088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.159203 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.159289 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.159952 (+ 663us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.160048 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:50:09.160493 2720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: Neither blocks nor log segments found. Creating new log.
I20260929 22:50:09.160813 2720 log.cc:824] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: Log is configured to *not* fsync() on all Append() calls
I20260929 22:50:09.161139 2724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:09.131840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52390 (local address 127.12.27.189:45217)
0929 22:50:09.131880 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.131882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.139759 (+ 7877us) server_negotiation.cc:407] Connection header received
0929 22:50:09.139951 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.139953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.139967 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.139998 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.142927 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.143690 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.147392 (+ 3702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:09.147722 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:09.147765 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:09.150490 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 22:50:09.150491 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 22:50:09.150491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 22:50:09.150498 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 22:50:09.152283 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.158703 (+ 6420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.158704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.158704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.158750 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 22:50:09.159464 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 22:50:09.159465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 22:50:09.159466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 22:50:09.159590 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 22:50:09.159677 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:09.160662 (+ 985us) server_negotiation.cc:299] Negotiation successful
0929 22:50:09.160736 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:50:09.168053 2835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624: Generated new TSK 0
I20260929 22:50:09.168262 2835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 22:50:09.171464 2720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: No bootstrap required, opened a new log
I20260929 22:50:09.173734 2720 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.173872 2720 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd2dfda8b5247ad97ab9340b6b00fc6, State: Initialized, Role: FOLLOWER
I20260929 22:50:09.173949 2720 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } }
I20260929 22:50:09.174311 2720 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 22:50:09.174415 2693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 22:50:09.175472 2693 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [term 1 FOLLOWER]: Refusing update from remote peer d29ee83b017f430c87c14b00e8c8f624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 22:50:09.175809 2833 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 22:50:09.175885 2694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d29ee83b017f430c87c14b00e8c8f624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6"
I20260929 22:50:09.174321 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.176949 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:09.176693 2694 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d29ee83b017f430c87c14b00e8c8f624 in term 1.
I20260929 22:50:09.178411 2857 mvcc.cc:205] Tried to move back new op lower bound from 7334798168747114496 to 7334798168581152768. Current Snapshot: MvccSnapshot[applied={T|T < 7334798168590168064}]
W20260929 22:50:09.178838 2856 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 22:50:09.178890 2856 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 22:50:09.179164 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d29ee83b017f430c87c14b00e8c8f624. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.179270 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 22:50:09.179330 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.179404 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 22:50:09.191720 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.190451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52402 (local address 127.12.27.189:45217)
0929 22:50:09.190488 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.190490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.191049 (+ 559us) server_negotiation.cc:407] Connection header received
0929 22:50:09.191135 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.191136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.191147 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.191199 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.191658 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52402: BlockingRecv error: recv got EOF from 127.0.0.1:52402 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:50:09.192116 2800 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.190685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58528 (local address 127.12.27.188:33031)
0929 22:50:09.190723 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.190725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.191498 (+ 773us) server_negotiation.cc:407] Connection header received
0929 22:50:09.191586 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.191586 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.191596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.191647 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.192055 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58528: BlockingRecv error: recv got EOF from 127.0.0.1:58528 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 22:50:09.192178 2647 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.190189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42608 (local address 127.12.27.190:33177)
0929 22:50:09.190230 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.190232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.191187 (+ 955us) server_negotiation.cc:407] Connection header received
0929 22:50:09.191278 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.191279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.191289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.191319 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.192116 (+ 797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42608: BlockingRecv error: recv got EOF from 127.0.0.1:42608 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 22:50:09.194293 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.193589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.12.27.189:45217)
0929 22:50:09.193622 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.193624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.193810 (+ 186us) server_negotiation.cc:407] Connection header received
0929 22:50:09.193912 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.193912 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.193929 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.193971 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.194251 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52408: BlockingRecv error: recv got EOF from 127.0.0.1:52408 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:50:09.197280 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.196567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52422 (local address 127.12.27.189:45217)
0929 22:50:09.196597 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.196599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.196817 (+ 218us) server_negotiation.cc:407] Connection header received
0929 22:50:09.196907 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.196908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.196916 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.196944 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.197241 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52422: BlockingRecv error: recv got EOF from 127.0.0.1:52422 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:50:09.201052 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.200341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52424 (local address 127.12.27.189:45217)
0929 22:50:09.200372 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.200374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.200589 (+ 215us) server_negotiation.cc:407] Connection header received
0929 22:50:09.200679 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.200680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.200689 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.200717 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.201012 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52424: BlockingRecv error: recv got EOF from 127.0.0.1:52424 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 22:50:09.206799 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.206078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.12.27.189:45217)
0929 22:50:09.206110 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.206112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.206331 (+ 219us) server_negotiation.cc:407] Connection header received
0929 22:50:09.206421 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.206421 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.206430 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.206457 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.206755 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52440: BlockingRecv error: recv got EOF from 127.0.0.1:52440 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 22:50:09.216735 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.215886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52446 (local address 127.12.27.189:45217)
0929 22:50:09.215919 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.215921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.216222 (+ 301us) server_negotiation.cc:407] Connection header received
0929 22:50:09.216340 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.216341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.216351 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.216379 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.216690 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52446: BlockingRecv error: recv got EOF from 127.0.0.1:52446 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 22:50:09.234912 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.233996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52456 (local address 127.12.27.189:45217)
0929 22:50:09.234039 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.234041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.234326 (+ 285us) server_negotiation.cc:407] Connection header received
0929 22:50:09.234431 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.234432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.234443 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.234474 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.234852 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52456: BlockingRecv error: recv got EOF from 127.0.0.1:52456 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 22:50:09.269346 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.268352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52458 (local address 127.12.27.189:45217)
0929 22:50:09.268399 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.268401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.268699 (+ 298us) server_negotiation.cc:407] Connection header received
0929 22:50:09.268815 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.268816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.268829 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.268861 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.269283 (+ 422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52458: BlockingRecv error: recv got EOF from 127.0.0.1:52458 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260929 22:50:09.335666 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.334790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52464 (local address 127.12.27.189:45217)
0929 22:50:09.334850 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.334853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.335027 (+ 174us) server_negotiation.cc:407] Connection header received
0929 22:50:09.335111 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.335112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.335131 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.335192 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.335564 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52464: BlockingRecv error: recv got EOF from 127.0.0.1:52464 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 22:50:09.465734 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.464877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.12.27.189:45217)
0929 22:50:09.465002 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.465005 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.465106 (+ 101us) server_negotiation.cc:407] Connection header received
0929 22:50:09.465196 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.465198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.465216 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.465277 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.465664 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52468: BlockingRecv error: recv got EOF from 127.0.0.1:52468 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260929 22:50:09.723948 2724 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 22:50:09.723102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52470 (local address 127.12.27.189:45217)
0929 22:50:09.723183 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:09.723185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:09.723199 (+ 14us) server_negotiation.cc:407] Connection header received
0929 22:50:09.723318 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:09.723320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:09.723342 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:09.723416 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 22:50:09.723862 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52470: BlockingRecv error: recv got EOF from 127.0.0.1:52470 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 22:50:09.734020 2923 sys_catalog.cc:455] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d29ee83b017f430c87c14b00e8c8f624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29ee83b017f430c87c14b00e8c8f624" member_type: VOTER last_known_addr { host: "127.12.27.190" port: 33177 } } peers { permanent_uuid: "bfd2dfda8b5247ad97ab9340b6b00fc6" member_type: VOTER last_known_addr { host: "127.12.27.189" port: 45217 } } peers { permanent_uuid: "90b08c06b80142e2a4fd377f8de37ad2" member_type: VOTER last_known_addr { host: "127.12.27.188" port: 33031 } } }
I20260929 22:50:09.734191 2923 sys_catalog.cc:458] T 00000000000000000000000000000000 P d29ee83b017f430c87c14b00e8c8f624 [sys.catalog]: This master's current role is: LEADER
I20260929 22:50:10.122396 2827 catalog_manager.cc:1259] Loaded cluster ID: da587affd01a4a69a36c9cb01e1dd15d
I20260929 22:50:10.122524 2827 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: loading cluster ID for follower catalog manager: success
I20260929 22:50:10.123363 2827 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: acquiring CA information for follower catalog manager: success
I20260929 22:50:10.123709 2827 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 90b08c06b80142e2a4fd377f8de37ad2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:50:10.179243 2856 catalog_manager.cc:1259] Loaded cluster ID: da587affd01a4a69a36c9cb01e1dd15d
I20260929 22:50:10.179319 2856 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: loading cluster ID for follower catalog manager: success
I20260929 22:50:10.180272 2856 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: acquiring CA information for follower catalog manager: success
I20260929 22:50:10.180593 2856 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bfd2dfda8b5247ad97ab9340b6b00fc6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 22:50:10.239876 2931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:10.237265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52480 (local address 127.12.27.189:45217)
0929 22:50:10.237374 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:10.237376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:10.237427 (+ 51us) server_negotiation.cc:407] Connection header received
0929 22:50:10.237460 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:10.237460 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:10.237509 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:10.237602 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:10.237738 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.238286 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.239068 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.239269 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.239334 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:10.239513 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:10.239669 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:10.239743 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:10.239785 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 22:50:10.239807 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":62,"threads_started":1}
I20260929 22:50:10.244005 2937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:10.241772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.12.27.188:33031)
0929 22:50:10.241890 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:10.241892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:10.241901 (+ 9us) server_negotiation.cc:407] Connection header received
0929 22:50:10.241938 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:10.241939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:10.241972 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:10.242072 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:10.242157 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.242621 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.243285 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.243468 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.243528 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:10.243703 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:10.243810 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:10.243873 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:10.243911 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 22:50:10.243927 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
I20260929 22:50:10.248565 2931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:10.245633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52492 (local address 127.12.27.189:45217)
0929 22:50:10.245672 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:10.245674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:10.245825 (+ 151us) server_negotiation.cc:407] Connection header received
0929 22:50:10.245915 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:10.245917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:10.245927 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:10.245994 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:10.246094 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.246709 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.247706 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.248014 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.248071 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:10.248234 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:10.248290 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:10.248339 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:10.248445 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 22:50:10.248473 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 22:50:10.248912 2937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:10.245666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58548 (local address 127.12.27.188:33031)
0929 22:50:10.245703 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:10.245704 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:10.246180 (+ 476us) server_negotiation.cc:407] Connection header received
0929 22:50:10.246273 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:10.246274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:10.246283 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:10.246334 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:10.246446 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.247151 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.248037 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.248318 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.248376 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:10.248621 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:10.248655 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:10.248687 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:10.248798 (+ 111us) server_negotiation.cc:299] Negotiation successful
0929 22:50:10.248819 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 22:50:10.248950 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 22:50:10.245746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42614 (local address 127.12.27.190:33177)
0929 22:50:10.245866 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 22:50:10.245868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 22:50:10.245876 (+ 8us) server_negotiation.cc:407] Connection header received
0929 22:50:10.245925 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 22:50:10.245926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 22:50:10.245978 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 22:50:10.246057 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 22:50:10.246172 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.246975 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.247922 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 22:50:10.248239 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 22:50:10.248306 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 22:50:10.248499 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 22:50:10.248608 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 22:50:10.248686 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 22:50:10.248828 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 22:50:10.248855 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":49,"threads_started":1}
I20260929 22:50:10.258157 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2576
I20260929 22:50:10.263178 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2651
I20260929 22:50:10.267889 12398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskh9tbJl/build/release/bin/kudu with pid 2727
2026-09-29T22:50:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2883 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5665 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (294589 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS